-- Logs begin at Thu 2022-05-26 17:04:06 UTC, end at Thu 2022-05-26 18:18:50 UTC. -- May 26 17:45:30.232274 dv-cinder-836074-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 17:45:30.240796 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 17:45:30.243440 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 17:45:30 2022] *** May 26 17:45:30.243589 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 17:45:30.243686 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 17:45:30.243792 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: nodename: dv-cinder-836074-5-iscsi May 26 17:45:30.243891 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: machine: x86_64 May 26 17:45:30.243994 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: clock source: unix May 26 17:45:30.244120 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: pcre jit disabled May 26 17:45:30.244242 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: detected number of CPU cores: 4 May 26 17:45:30.244242 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: current working directory: / May 26 17:45:30.244242 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: detected binary path: /usr/bin/uwsgi-core May 26 17:45:30.244242 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: your processes number limit is 47680 May 26 17:45:30.244242 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: your memory page size is 4096 bytes May 26 17:45:30.244242 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: detected max file descriptor number: 2048 May 26 17:45:30.244242 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: lock engine: pthread robust mutexes May 26 17:45:30.244665 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: thunder lock: enabled May 26 17:45:30.244665 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 17:45:30.244665 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 17:45:30.289977 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: Python main interpreter initialized at 0x557a4ecdb9c0 May 26 17:45:30.289977 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: python threads support enabled May 26 17:45:30.289977 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: your server socket listen backlog is limited to 100 connections May 26 17:45:30.289977 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: your mercy for graceful operations on workers is 90 seconds May 26 17:45:30.290395 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: mapped 403077 bytes (393 KB) for 2 cores May 26 17:45:30.290395 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: *** Operational MODE: preforking *** May 26 17:45:30.290684 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: *** uWSGI is running in multiple interpreter mode *** May 26 17:45:30.290684 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: spawned uWSGI master process (pid: 80182) May 26 17:45:30.290894 dv-cinder-836074-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 17:45:30.295200 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: spawned uWSGI worker 1 (pid: 80192, cores: 1) May 26 17:45:30.295200 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: spawned uWSGI worker 2 (pid: 80193, cores: 1) May 26 17:45:30.295200 dv-cinder-836074-5-iscsi devstack@keystone.service[80182]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 17:45:36.079470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:45:36.079470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes May 26 17:45:36.080333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:45:36.080333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes May 26 17:45:36.129544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:45:36.129732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:45:36.129913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] command line args: [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:45:36.130184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:45:36.130364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ================================================================================ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:45:36.130622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.130873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_dir = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.131062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.131245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_source = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.131426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] debug = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.131627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.132152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.132256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.132444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.132694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.132928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.133108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_config_append = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.133287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.133375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:45:36.133375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes May 26 17:45:36.133849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_dir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.133849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.133963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:45:36.133963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes May 26 17:45:36.134058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.134121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.134338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.134570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.134748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.134928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.135176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.135425 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.135657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.135890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.136148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.136382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.136633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.136880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.137157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.137652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.138372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] publish_errors = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.138615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.139035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.139214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.139457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.139695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.139935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] standard_threads = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.140197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.140446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.140627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.140806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_journal = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.140984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_json = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.141159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_stderr = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.141337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_syslog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.141568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.141828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.142069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.142332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.142577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.142831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.143073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.143329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.143568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.143820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.144100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.144357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.144592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.144843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.145081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.145331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.145579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.145819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.146077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.146335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.146583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.146821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.147077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.147341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.147595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.147845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.148103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.148340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.148574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.148811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.149063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.149315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.149550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.149785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.150035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.150284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.150777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.151028 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.151263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.151503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.151741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.151975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.152233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.152468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.152702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.152941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.153191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.153444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.154247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.154487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.154729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.154971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.155225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.155458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.155698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.155937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.156201 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.156440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.156679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.156912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.157163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.157401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.157642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.157875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.158143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.158378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.158609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.158849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.159087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.159358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.159598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.159848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.160122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.160362 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.160599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.160834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.161084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.161322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.161560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.161805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.162043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.162279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.162515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.162751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.162987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.163251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.163495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.163738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.163977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.164253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.164492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.164730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.164967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.165200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.165433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.165666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.165903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.166148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.166378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.166614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.166866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.167104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.167361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.167620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.167863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.168123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.external = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.168359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.168655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.168889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.169150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.password = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.169384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.token = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.169625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.169861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.170109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.170342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.170591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.170842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.171075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.171312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.171561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.171810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.172086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.172330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.172575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.172811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.173064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.173318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.173555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.173807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.174130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.174351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.174615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.174859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.175119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.175357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.175596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.175842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.176118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.176354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.176604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.176843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.177100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.177338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.177593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.177831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.178079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.178318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.178570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.178820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.179058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.179295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.179541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.179776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.180053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.180299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.180537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.180785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.181004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.181236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.181483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.181730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.181978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.182247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.182480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.182751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.182991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.183134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:45:36.183216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.183325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:45:36.183473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.183643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] command line args: [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:45:36.183775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.183864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:45:36.183946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.184063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ================================================================================ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:45:36.184160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.184252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.184404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.184481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config_dir = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.184620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.184719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.184860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config_source = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.184997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.185122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.185361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.185503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] debug = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.185606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.185727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.185836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.185971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.186076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.186154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.186325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.186412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.186557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.186636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.186796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.186872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.187020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_config_append = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.187104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.187200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.187278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.187378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_dir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.187479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.187563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.187725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.187803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.187963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.188060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.188241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.188319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.188494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.188575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.188671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.188748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.188848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.189006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.189082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.189187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.189324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.189439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.189556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.189689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.189789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.189928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.190005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.190166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.190244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.190405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.190484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.190638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.190715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.190881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.190971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.191141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.191375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.191461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.191617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] publish_errors = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.191694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.191851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.191931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.192104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.192272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.192351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.192517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.192667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.192747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.192974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] standard_threads = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.193051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.193205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.193283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.193446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.193526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.193624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.193709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.193783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_journal = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.193902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.193988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_json = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.194120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_stderr = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.194197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.194295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_syslog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.194379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.194524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:45:36.194610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.194779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.194887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.195848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.196994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.197939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198649 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.198974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.199930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.200130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.200244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.201023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.201114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.201270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.201524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.201785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.201883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202028 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.202996 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.203955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.204957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.205976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.206141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.206225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.206373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.206451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.206609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.206690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.206857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207381 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.207852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208498 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.208976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.209996 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.210960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.211901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.212921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.213875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.214979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.215909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.216613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.216889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.217143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.217364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.217452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.217614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.217692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.217851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.217931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.218896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.219987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.220951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.221028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.221123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:45:36.221203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.221438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.221703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.221972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.222183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.external = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.222417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.222714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.222949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.223182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.password = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.223414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.token = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.223661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.223899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.224176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.224409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.224658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.224908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.225141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.225377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.225624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.225873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.226121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.226356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.226602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.226837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.227106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.227362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.227600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.227852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.228167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.228428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.228689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.228933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.229224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.229462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.229699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.229945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.230193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.230424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.230681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.230920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.231175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.231412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.231693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.232493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.232749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.232993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.233247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.233497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.233744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.233984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.234233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.234467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.234707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.234957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.235207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.235445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.235673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.235904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.236181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.236433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.236681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.236936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.237184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.237456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.237696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.237933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.238164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.238400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.238631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.238866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.239107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.239346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.239592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.239822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.240093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.240340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.240575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.240821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.241067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.241297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.241532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.241762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.241999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.242235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.242478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.242715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.242951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.243199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.243450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.243683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.243909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.244181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.244484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.244724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.244979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.245215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.245448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.245688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.245947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.246180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.246426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.246673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.246919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.247155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.247926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.248205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.248451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.248695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.249057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.249315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.249569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.249822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.250073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.250328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.250565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.250815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.251065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.251306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.251546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.251782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.252071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.252203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.252287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.252438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.252519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.252663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.252773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.253005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.253252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.253494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.253733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.253972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.254221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.254465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.254697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.254937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.255179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.255431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.255678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.255916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.256195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.256450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.256688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.256933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.257170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.257411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.257646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.257892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.258123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.258373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.258621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.258868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.259115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.259359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.259603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.259848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.260119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.260355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.260603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.260849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.261097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.261344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.261414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.261770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.262007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.262267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.262517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.263359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.264110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.264368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.264631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.264886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.265129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.265362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.265597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.265832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.266083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.266339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.266587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.266825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.267062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.267293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.267529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.267765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.268022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.268271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.268528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.268774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.269013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.269257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.269499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.269746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.269981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.270221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.270454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.270698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.270946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.271176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.271419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.271709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.271968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.272244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.272494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.272733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.272973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.273209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.273445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.273680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.273920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.274167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.274399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.274641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.274875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.275122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.275356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.275852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.276104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.276347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.276581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:45:36.276750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:45:36.291653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.291868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.303631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.303865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.304118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.314946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.334752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.334918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.346960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.375512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.399414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.399650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.414838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.415077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.468156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.468381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.468607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.468828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.469049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.469134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.469265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.469348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.469575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.469795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.470013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.470230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.492536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.492728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.492816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.492963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.493909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.494027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.505737 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.505839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.519042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.519278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.519507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.519589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.519732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.519816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.519951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.520051 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.520194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.520275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.520409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.520488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.520622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.520834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:45:36.538765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.538888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.538960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:45:36.539074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:45:36.539296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.539411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.539492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:45:36.539614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:45:36.539744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.539883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.540001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.540176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.540277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.540431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.540523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.540685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.551752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.552050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.552323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.552607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.553512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.553786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.554055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.554333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.561229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.563418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.564548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.564826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.565106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.565395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.565677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.565934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.566199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.566585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.566694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.566858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.566972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.567133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.567249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.567400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.567524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.567800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.568198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.568473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.568749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.569019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.569291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.569556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.594550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.596252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.596541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.597405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.599142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.599437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.601802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.602081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.602361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.604727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.605003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.605278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.609775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.610058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.613026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.613306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.614534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.614935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.615220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.615508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.615786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.616088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.616368 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.616637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.617750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.618143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.618420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.618700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.618974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.619250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.619520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.619786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.635869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.636167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.640249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.640525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.641538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.645100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.645229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.645520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.648693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.648986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.650810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.654561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.654742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.658376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.658475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.658673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.658968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.659251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.659534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.659810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.662240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.662535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.662823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.663117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.663395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.663678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.678685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.678967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.679234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.679494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.682902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.683182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.683443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.683703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.688225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.689940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.690217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.692662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.693290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.693570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.693848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.694125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.694359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.694439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.694648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.697699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.697977 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.698253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.698527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.698796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.708190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.708469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.708748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.709035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.709316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.709591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.709873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.712833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.713110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.713387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.713676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.713953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.714238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.714517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.728338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.732488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.735543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.735817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.737412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.738812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.739047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.739336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.739618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.742110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.743720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.745363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.745647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.745934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.746978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.748841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.752240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.752534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.752818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.753095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.753852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.755453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.758683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.758966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.759246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.759527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.762192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.762485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.762909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.769444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.769729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.770111 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.771004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.771288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.771570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.771924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.772145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.772420 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.772716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.773052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.773265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.773540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.773809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.774069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.774346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.774614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.778212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:45:36.779003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.779774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.780070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.780342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.780610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.780880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.781160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.781434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.781708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.781974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.782230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.782490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.782752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:45:36.814818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a4ecdb9c0 pid: 80192 (default app) May 26 17:45:36.818079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b282-425f-4a51-bfae-8b5ae177a053 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:36.818375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b282-425f-4a51-bfae-8b5ae177a053 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:36.818656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b282-425f-4a51-bfae-8b5ae177a053 None None] PATH_INFO: `/v3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:36.822689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a4ecdb9c0 pid: 80193 (default app) May 26 17:45:36.822947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Thu May 26 17:45:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:44.882115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9f51-554b-4633-a045-24f8b4a765fc None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:44.882680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9f51-554b-4633-a045-24f8b4a765fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:44.882680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9f51-554b-4633-a045-24f8b4a765fc None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:44.887052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:44.892343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:44.892800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:44.892985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:44.962367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: INFO dbcounter [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] Registered counter for database keystone May 26 17:45:44.984977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG oslo_db.sqlalchemy.engines [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:45:44.991228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writer thread running {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:45:45.169719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80192) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 17:45:45.170027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80192) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 17:45:45.225970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:45.227590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:45.352204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 17:45:45.517403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f9f51-554b-4633-a045-24f8b4a765fc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:45.586635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: INFO dbcounter [None req-db7f9f51-554b-4633-a045-24f8b4a765fc None None] Registered counter for database keystone May 26 17:45:45.607787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG oslo_db.sqlalchemy.engines [None req-db7f9f51-554b-4633-a045-24f8b4a765fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:45:45.614018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writer thread running {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:45:45.736273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f9f51-554b-4633-a045-24f8b4a765fc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:45.740492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27031a-231a-4ea1-af96-ba432e54b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:45.741154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27031a-231a-4ea1-af96-ba432e54b162 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:45.741439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27031a-231a-4ea1-af96-ba432e54b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:45.741717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27031a-231a-4ea1-af96-ba432e54b162 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:45.750420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27031a-231a-4ea1-af96-ba432e54b162 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:45.803342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f27031a-231a-4ea1-af96-ba432e54b162 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 17:45:45.803610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27031a-231a-4ea1-af96-ba432e54b162 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:45.813859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Thu May 26 17:45:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:45:45.819933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:45.834939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64008d-97c0-4a7a-8af0-8756a541665e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:45.839358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafafe-156a-4f13-9f95-9359ca301e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:45.841116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafafe-156a-4f13-9f95-9359ca301e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:45.841404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafafe-156a-4f13-9f95-9359ca301e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:45.841697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafafe-156a-4f13-9f95-9359ca301e03 admin admin] PATH_INFO: `/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:45.843224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafafe-156a-4f13-9f95-9359ca301e03 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ff1c526db504733a6f9bcf8c7e9e653)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:46.002662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aaeafafe-156a-4f13-9f95-9359ca301e03 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 17:45:46.003338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafafe-156a-4f13-9f95-9359ca301e03 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:46.007678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Thu May 26 17:45:45 2022] GET /identity/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:48.196998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d176d08-4377-4dfb-a70c-0b8954edecd7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:48.197526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d176d08-4377-4dfb-a70c-0b8954edecd7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:48.197628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d176d08-4377-4dfb-a70c-0b8954edecd7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:48.202173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:48.207524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9a3f-9195-49eb-902c-ed12e02e2c8a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:48.207939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9a3f-9195-49eb-902c-ed12e02e2c8a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:48.208120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9a3f-9195-49eb-902c-ed12e02e2c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:48.227471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-abec9a3f-9195-49eb-902c-ed12e02e2c8a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:48.229021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abec9a3f-9195-49eb-902c-ed12e02e2c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:48.237195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 17:45:48.259763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d176d08-4377-4dfb-a70c-0b8954edecd7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:48.272693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d176d08-4377-4dfb-a70c-0b8954edecd7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:48.277224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa62d3-a989-4266-b8e9-302f861bc7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:48.278456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa62d3-a989-4266-b8e9-302f861bc7db admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:48.278831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa62d3-a989-4266-b8e9-302f861bc7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:48.279194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa62d3-a989-4266-b8e9-302f861bc7db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:48.287018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa62d3-a989-4266-b8e9-302f861bc7db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:48.288832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa62d3-a989-4266-b8e9-302f861bc7db admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:48.297789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Thu May 26 17:45:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:45:48.303292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9a3f-9195-49eb-902c-ed12e02e2c8a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:48.312901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9a3f-9195-49eb-902c-ed12e02e2c8a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:48.317263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82b62-865f-4776-8140-01ae8efe041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:48.318118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82b62-865f-4776-8140-01ae8efe041c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:48.318402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82b62-865f-4776-8140-01ae8efe041c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:48.318676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82b62-865f-4776-8140-01ae8efe041c admin admin] PATH_INFO: `/v3/users/c2a69d3812404e20840e7bb0da9d4d1a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:48.320080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82b62-865f-4776-8140-01ae8efe041c admin admin] RBAC: Authorizing `identity:get_user(user_id=c2a69d3812404e20840e7bb0da9d4d1a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:48.321912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82b62-865f-4776-8140-01ae8efe041c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:48.323453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Thu May 26 17:45:48 2022] GET /identity/v3/users/c2a69d3812404e20840e7bb0da9d4d1a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:50.612981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae46b0-7b69-4162-8afd-f8fa85981c99 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:50.613523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae46b0-7b69-4162-8afd-f8fa85981c99 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:50.613617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae46b0-7b69-4162-8afd-f8fa85981c99 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:50.615009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:50.620278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952afaef-f379-45a4-8703-378351887900 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:50.620699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952afaef-f379-45a4-8703-378351887900 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:50.620842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952afaef-f379-45a4-8703-378351887900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:50.630430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809da2-a838-48ef-a067-c94090d54238 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:50.630721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809da2-a838-48ef-a067-c94090d54238 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:50.631002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809da2-a838-48ef-a067-c94090d54238 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:50.632360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:45:50.637974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:50.638500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-952afaef-f379-45a4-8703-378351887900 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:50.638651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:50.638936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:50.639668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-952afaef-f379-45a4-8703-378351887900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:50.678920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80193) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 17:45:50.679341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80193) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 17:45:50.720992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:45:50.726652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:50.728300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:50.742604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952afaef-f379-45a4-8703-378351887900 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:50.767749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:50.829796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:45:50.849869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952afaef-f379-45a4-8703-378351887900 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:50.852366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:50.885255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:50.885829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:50.886118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:50.886401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:50.954053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e67d6-e99f-43d5-b0b8-dd2e65526249 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:50.955026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:50.956376 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:50.956556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:50.979418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:50.991461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:50.992537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:50.992829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:50.993108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:51.005334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:45:51.017134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:45:51.018068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:45:51.018856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 8/14] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:45:51.024101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:51.058299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 7/15] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:45:51.064314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:51.126105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49057-d9e4-4105-b1f4-aa0477fb4c58 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:51.166720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18229b04-13de-4c58-a57d-db56ac11836e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:51.170982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:51.171655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:51.171944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:51.172249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:51.173008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:45:51.173321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:51.174762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:51.187956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 9/16] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:45:51.190731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:51.193690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:51.202837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:51.203638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:51.203924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:51.204242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:51.214714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:51.216572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:51.221793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:45:51.238105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:45:51.238987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:45:51.239780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:45:51.239780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:45:51.239780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:45:51.239780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:45:51.239780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 8/17] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:45:51.245360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:51.303302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b221bc-75a0-4ecd-9810-55255d1a92c2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:51.339134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:51.340059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:51.340385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:51.340737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] PATH_INFO: `/v3/users/c2a69d3812404e20840e7bb0da9d4d1a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:51.342320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a69d3812404e20840e7bb0da9d4d1a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:51.343792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:51.345476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 10/18] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:45:51 2022] GET /identity/v3/users/c2a69d3812404e20840e7bb0da9d4d1a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:45:51.348682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eacf5-2bae-41d2-92ff-7015889288a6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:51.350763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:51.385297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:51.385967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:51.386245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:51.386519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:51.387828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:45:51.388179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:51.389584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:51.407641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 9/19] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:45:51.452043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:51.460352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c6142-c578-45e1-8aaf-f26a2a5b78f1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:51.610965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416c4af-640f-4955-b5c5-f42e5f6cd203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:51.611771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416c4af-640f-4955-b5c5-f42e5f6cd203 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:51.612078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416c4af-640f-4955-b5c5-f42e5f6cd203 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:51.612354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416c4af-640f-4955-b5c5-f42e5f6cd203 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:51.613531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416c4af-640f-4955-b5c5-f42e5f6cd203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:51.614980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416c4af-640f-4955-b5c5-f42e5f6cd203 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:51.616671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 11/20] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:45:51.623672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:51.663151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:51.743134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e72fe-0297-43f5-8caf-596ffd798820 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:51.783390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0ec48-34b5-4e0a-848b-a5c7d9aea96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:51.784100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ec48-34b5-4e0a-848b-a5c7d9aea96c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:51.784390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ec48-34b5-4e0a-848b-a5c7d9aea96c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:51.786151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0ec48-34b5-4e0a-848b-a5c7d9aea96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:51.786151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0ec48-34b5-4e0a-848b-a5c7d9aea96c None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.domain.id=default, user.id=c2a69d3812404e20840e7bb0da9d4d1a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:45:51.786151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0ec48-34b5-4e0a-848b-a5c7d9aea96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:51.788840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0ec48-34b5-4e0a-848b-a5c7d9aea96c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:51.796357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 10/21] 10.222.0.69 () {56 vars in 1322 bytes} [Thu May 26 17:45:51 2022] GET /identity/v3/role_assignments?user.id=c2a69d3812404e20840e7bb0da9d4d1a&scope.domain.id=default&role.id=cde11b02d419404ea30981d75030a0a8 => generated 233 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:54.110176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7a3e-bcfd-484c-8996-13938319f31a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.111158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7a3e-bcfd-484c-8996-13938319f31a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.111646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7a3e-bcfd-484c-8996-13938319f31a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.113247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 12/22] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:54.118888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e5be-2f7a-4c39-a30a-b6b3e4946e52 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.119744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e5be-2f7a-4c39-a30a-b6b3e4946e52 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.120270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e5be-2f7a-4c39-a30a-b6b3e4946e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.142474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a984e5be-2f7a-4c39-a30a-b6b3e4946e52 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:54.144080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a984e5be-2f7a-4c39-a30a-b6b3e4946e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:54.226540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 11/23] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:45:54.265683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7a3e-bcfd-484c-8996-13938319f31a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:54.380600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7a3e-bcfd-484c-8996-13938319f31a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:54.418365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3a499-e26c-4712-b861-8509f208fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:54.419583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3a499-e26c-4712-b861-8509f208fdfd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.420093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3a499-e26c-4712-b861-8509f208fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.420589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3a499-e26c-4712-b861-8509f208fdfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.440836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3a499-e26c-4712-b861-8509f208fdfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:54.442707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3a499-e26c-4712-b861-8509f208fdfd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8ae3a499-e26c-4712-b861-8509f208fdfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:45:54.463017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:45:54.463877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:45:54.464686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:45:54.464686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:45:54.464686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:45:54.464686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:45:54.467759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 13/24] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:45:54.477423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e5be-2f7a-4c39-a30a-b6b3e4946e52 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:54.523300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:54.610415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e5be-2f7a-4c39-a30a-b6b3e4946e52 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:54.636043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cf4c-0417-45bd-893b-400bd0d75a1e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.636655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cf4c-0417-45bd-893b-400bd0d75a1e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.637178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cf4c-0417-45bd-893b-400bd0d75a1e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.638763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 14/25] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:45:54.649451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059f00-8996-4041-9fe9-23134989ff1b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.650268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059f00-8996-4041-9fe9-23134989ff1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.650766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059f00-8996-4041-9fe9-23134989ff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.678262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba754ff-68ce-41ba-89b9-bf4556b73578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:54.679365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba754ff-68ce-41ba-89b9-bf4556b73578 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.679856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba754ff-68ce-41ba-89b9-bf4556b73578 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.680364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba754ff-68ce-41ba-89b9-bf4556b73578 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.681337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba754ff-68ce-41ba-89b9-bf4556b73578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:45:54.682579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-22059f00-8996-4041-9fe9-23134989ff1b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:54.683102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba754ff-68ce-41ba-89b9-bf4556b73578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:54.684816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba754ff-68ce-41ba-89b9-bf4556b73578 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:54.686265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-22059f00-8996-4041-9fe9-23134989ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:54.705974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:54.707673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 12/26] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:54.710251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef1b2-252c-45ad-a3ed-35a744cc3cc3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.710543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef1b2-252c-45ad-a3ed-35a744cc3cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.710823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef1b2-252c-45ad-a3ed-35a744cc3cc3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.712110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:54.717292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef797c-1cd0-4cf6-b83d-a2c2ac0a16ba None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.717584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef797c-1cd0-4cf6-b83d-a2c2ac0a16ba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.717865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef797c-1cd0-4cf6-b83d-a2c2ac0a16ba None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.719592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 14/28] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:54.720689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b69f8-17e7-4efd-99cf-9c563ff0328f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.720979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b69f8-17e7-4efd-99cf-9c563ff0328f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.721258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b69f8-17e7-4efd-99cf-9c563ff0328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.743382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-978b69f8-17e7-4efd-99cf-9c563ff0328f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:54.744868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-978b69f8-17e7-4efd-99cf-9c563ff0328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:54.787321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 15/29] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:45:54.788841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059f00-8996-4041-9fe9-23134989ff1b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:54.826503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 15/30] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:45:54.827969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ef33-b4ae-4128-a2df-18278dc7dcf7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.828521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ef33-b4ae-4128-a2df-18278dc7dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.829117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ef33-b4ae-4128-a2df-18278dc7dcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.857367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7804ef33-b4ae-4128-a2df-18278dc7dcf7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:54.859323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7804ef33-b4ae-4128-a2df-18278dc7dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:54.902009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059f00-8996-4041-9fe9-23134989ff1b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:54.904355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:54.941962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:54.943074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:54.943536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:54.944048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:54.944990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:54.946807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:54.950720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 16/31] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:45:54.951993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ef33-b4ae-4128-a2df-18278dc7dcf7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:54.967699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:55.073639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ef33-b4ae-4128-a2df-18278dc7dcf7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:55.111343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 16/32] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:45:54 2022] POST /identity/v3/projects => generated 301 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:45:55.113267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:55.113718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:55.114518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:55.114997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:55.115381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:55.116427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:55.118476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:55.244040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d342-8364-4c90-8428-1253533a10c9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:55.274915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 17/33] 10.222.0.69 () {60 vars in 1131 bytes} [Thu May 26 17:45:54 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:45:55.276583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:55.308508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:55.385747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:55.386448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:55.386858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:55.387753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:55.388590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:55.390177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:55.422107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 17/34] 10.222.0.69 () {60 vars in 1131 bytes} [Thu May 26 17:45:55 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:45:55.472400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6609a40-90aa-494e-a483-8288480d4000 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:55.523047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:55.523804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:55.524155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:55.524446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:55.539106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:45:55.549138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:45:55.550042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:45:55.550795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 18/35] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:45:55.556720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:55.629076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:55.685965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789414d9-21aa-4786-8326-f77c3146a66d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:55.725385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dee5b-c173-49cc-bf93-a0ddd821feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:55.726085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dee5b-c173-49cc-bf93-a0ddd821feaf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:55.726377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dee5b-c173-49cc-bf93-a0ddd821feaf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:55.726662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dee5b-c173-49cc-bf93-a0ddd821feaf None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:55.727439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dee5b-c173-49cc-bf93-a0ddd821feaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:45:55.727848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dee5b-c173-49cc-bf93-a0ddd821feaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:55.729282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dee5b-c173-49cc-bf93-a0ddd821feaf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:55.739228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 18/36] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:55.744817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:55.819927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff286a-fae7-496a-bc9b-501341c2fc43 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:55.820270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff286a-fae7-496a-bc9b-501341c2fc43 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:55.820543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff286a-fae7-496a-bc9b-501341c2fc43 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:55.823228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 19/37] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:55.829294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab307d3-30a0-4d75-a068-2f5e6ba5e763 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:55.830301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab307d3-30a0-4d75-a068-2f5e6ba5e763 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:55.831016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab307d3-30a0-4d75-a068-2f5e6ba5e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:55.838653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:55.851367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4ab307d3-30a0-4d75-a068-2f5e6ba5e763 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:55.853050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4ab307d3-30a0-4d75-a068-2f5e6ba5e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:55.881436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e603-a7d9-41c2-a24b-316e1a7b038c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:55.921299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:55.922321 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:55.922614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:55.922902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] PATH_INFO: `/v3/users/c2a69d3812404e20840e7bb0da9d4d1a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:55.924239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a69d3812404e20840e7bb0da9d4d1a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:55.925026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 20/38] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:45:55.928183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:55.928183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 19/39] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:45:55 2022] GET /identity/v3/users/c2a69d3812404e20840e7bb0da9d4d1a => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:55.932740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab307d3-30a0-4d75-a068-2f5e6ba5e763 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:55.952241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:55.987049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:56.043851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab307d3-30a0-4d75-a068-2f5e6ba5e763 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:56.059997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a55246-b761-4a27-bd56-5e53ab0f96f2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:56.080637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4cf8-f442-499a-a117-f1b845548799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:56.081363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4cf8-f442-499a-a117-f1b845548799 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:56.081650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4cf8-f442-499a-a117-f1b845548799 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:56.081934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4cf8-f442-499a-a117-f1b845548799 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:56.083121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a4cf8-f442-499a-a117-f1b845548799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:56.084634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a4cf8-f442-499a-a117-f1b845548799 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:56.086261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 21/40] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:56.087442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce597-7a5a-4f78-ab3b-b11e98e3954c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:56.087737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce597-7a5a-4f78-ab3b-b11e98e3954c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:56.088041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce597-7a5a-4f78-ab3b-b11e98e3954c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:56.089274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 22/41] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:56.093177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ce597-7a5a-4f78-ab3b-b11e98e3954c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:56.096622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364ca6-8fc9-48df-9242-38c363a54b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:56.097474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364ca6-8fc9-48df-9242-38c363a54b2e None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:56.097768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364ca6-8fc9-48df-9242-38c363a54b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:56.098054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364ca6-8fc9-48df-9242-38c363a54b2e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:56.098813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364ca6-8fc9-48df-9242-38c363a54b2e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:56.100256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364ca6-8fc9-48df-9242-38c363a54b2e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:56.103301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:56.115294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 20/42] 10.222.0.69 () {60 vars in 1131 bytes} [Thu May 26 17:45:55 2022] POST /identity/v3/roles => generated 223 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:45:56.116648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069775-3748-4141-8a95-ce5067369ee9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:56.116982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069775-3748-4141-8a95-ce5067369ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:56.117257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069775-3748-4141-8a95-ce5067369ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:56.140907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a7069775-3748-4141-8a95-ce5067369ee9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:56.142587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a7069775-3748-4141-8a95-ce5067369ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:56.218836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ce597-7a5a-4f78-ab3b-b11e98e3954c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:56.234843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 21/43] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:45:56.238495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:56.259243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7069775-3748-4141-8a95-ce5067369ee9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:56.259971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:56.260984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:56.261348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:56.262365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] PATH_INFO: `/v3/domains/default/users/c2a69d3812404e20840e7bb0da9d4d1a/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:56.264707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c2a69d3812404e20840e7bb0da9d4d1a, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:56.266276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:56.285350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 23/44] 10.222.0.69 () {58 vars in 1361 bytes} [Thu May 26 17:45:56 2022] PUT /identity/v3/domains/default/users/c2a69d3812404e20840e7bb0da9d4d1a/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:45:56.382966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7069775-3748-4141-8a95-ce5067369ee9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:56.412251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:56.422091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03da60-cd01-47b6-ba3f-e39d11fee6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:56.422915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03da60-cd01-47b6-ba3f-e39d11fee6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:56.423203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03da60-cd01-47b6-ba3f-e39d11fee6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:56.423483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03da60-cd01-47b6-ba3f-e39d11fee6e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:56.424781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03da60-cd01-47b6-ba3f-e39d11fee6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:56.426290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03da60-cd01-47b6-ba3f-e39d11fee6e5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:56.428032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 22/45] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:45:56.435019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:56.538394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35220c-46f9-4b16-9cf1-519d483aa1e0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:56.572140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26418e8b-b0ec-43a4-ac66-fac830744e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:56.572818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26418e8b-b0ec-43a4-ac66-fac830744e6f None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:56.573110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26418e8b-b0ec-43a4-ac66-fac830744e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:56.573392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26418e8b-b0ec-43a4-ac66-fac830744e6f None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:56.574631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26418e8b-b0ec-43a4-ac66-fac830744e6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:56.576120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26418e8b-b0ec-43a4-ac66-fac830744e6f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:56.600992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:45:56 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:45:58.526211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba52d-fce0-420b-a9a6-091435a156af None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:58.526738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba52d-fce0-420b-a9a6-091435a156af None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:58.526846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba52d-fce0-420b-a9a6-091435a156af None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:58.528246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 23/47] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:45:58.533557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64cee-7b81-4908-ba69-6dce00ebd4b0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:58.534005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64cee-7b81-4908-ba69-6dce00ebd4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:58.534134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64cee-7b81-4908-ba69-6dce00ebd4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:58.550848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-60f64cee-7b81-4908-ba69-6dce00ebd4b0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:58.552074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60f64cee-7b81-4908-ba69-6dce00ebd4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:58.575844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:58.620689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 25/48] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:45:58.644361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ba52d-fce0-420b-a9a6-091435a156af None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:58.750684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ba52d-fce0-420b-a9a6-091435a156af None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:58.784792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eab7b-f66a-4012-90db-d7325bc3400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:58.785512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eab7b-f66a-4012-90db-d7325bc3400d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:58.785802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eab7b-f66a-4012-90db-d7325bc3400d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:58.786085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eab7b-f66a-4012-90db-d7325bc3400d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:58.797064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eab7b-f66a-4012-90db-d7325bc3400d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e58eab7b-f66a-4012-90db-d7325bc3400d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:45:58.804739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:45:58.805553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:45:58.806479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 24/49] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:45:58.812685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f64cee-7b81-4908-ba69-6dce00ebd4b0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:58.840776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb459d4-b865-46aa-ba58-8429417b7021 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:58.841071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb459d4-b865-46aa-ba58-8429417b7021 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:58.841349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb459d4-b865-46aa-ba58-8429417b7021 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:58.842734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 25/50] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:45:58.847951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3afcd0-7a03-4142-90b8-90406ebac781 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:58.848270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3afcd0-7a03-4142-90b8-90406ebac781 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:58.848554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3afcd0-7a03-4142-90b8-90406ebac781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:58.865781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-be3afcd0-7a03-4142-90b8-90406ebac781 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:45:58.866976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be3afcd0-7a03-4142-90b8-90406ebac781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:45:58.912084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f64cee-7b81-4908-ba69-6dce00ebd4b0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:58.918476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:58.936175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 26/51] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:45:58.945857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:58.946539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:58.946831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:58.947114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:58.947877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:45:58.948225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:58.950288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:58.958432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 26/52] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:58.959784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3afcd0-7a03-4142-90b8-90406ebac781 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:58.963715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:58.986961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:59.064518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3afcd0-7a03-4142-90b8-90406ebac781 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:59.071793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e872e-632a-407f-a160-42ed9b755901 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:59.102865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:59.103678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:59.103968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:59.104283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:59.106301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:59.107405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:59.108980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:59.109213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 27/53] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:59.109893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:59.110177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:59.110457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] PATH_INFO: `/v3/users/c2a69d3812404e20840e7bb0da9d4d1a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:59.111745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a69d3812404e20840e7bb0da9d4d1a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:59.113242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:59.119152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 27/54] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:45:58 2022] GET /identity/v3/users/c2a69d3812404e20840e7bb0da9d4d1a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:59.119326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:59.120660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:59.173900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:59.216858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:45:59.222714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65695377-4c62-42fb-8978-1acd1128b6d5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:59.229724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359857-2fec-4529-89f6-f7c43b0f8a15 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:59.258953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141934-aec6-42b9-b924-653fa7c11c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:59.259635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141934-aec6-42b9-b924-653fa7c11c81 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:59.259956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141934-aec6-42b9-b924-653fa7c11c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:59.260247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141934-aec6-42b9-b924-653fa7c11c81 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:59.260970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141934-aec6-42b9-b924-653fa7c11c81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:59.263251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141934-aec6-42b9-b924-653fa7c11c81 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:59.279661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:59.280509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:59.280804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:59.281102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:59.282344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:59.283985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:59.286511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 28/55] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:45:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:45:59.292873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:45:59.308106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 28/56] 10.222.0.69 () {60 vars in 1140 bytes} [Thu May 26 17:45:59 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:45:59.412832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cdb45-cc83-4f22-a6d1-8e2fb980392a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:45:59.453793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d4c2c-a3a7-4f2b-9934-874d83749899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:45:59.454478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d4c2c-a3a7-4f2b-9934-874d83749899 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:45:59.454768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d4c2c-a3a7-4f2b-9934-874d83749899 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:45:59.455052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d4c2c-a3a7-4f2b-9934-874d83749899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:45:59.455919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d4c2c-a3a7-4f2b-9934-874d83749899 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.domain.id=default, user.id=c2a69d3812404e20840e7bb0da9d4d1a) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:45:59.456272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d4c2c-a3a7-4f2b-9934-874d83749899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:45:59.457789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d4c2c-a3a7-4f2b-9934-874d83749899 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:45:59.466930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 29/57] 10.222.0.69 () {56 vars in 1322 bytes} [Thu May 26 17:45:59 2022] GET /identity/v3/role_assignments?user.id=c2a69d3812404e20840e7bb0da9d4d1a&scope.domain.id=default&role.id=cde11b02d419404ea30981d75030a0a8 => generated 530 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:01.545320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d87ba-fe79-47db-b224-f5fb4974a38d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:01.545837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d87ba-fe79-47db-b224-f5fb4974a38d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:01.545924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d87ba-fe79-47db-b224-f5fb4974a38d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:01.547261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 29/58] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:01.552554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd8570-b024-4585-81c8-e9f5c496adce None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:01.552982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd8570-b024-4585-81c8-e9f5c496adce None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:01.553126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd8570-b024-4585-81c8-e9f5c496adce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:01.569792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-32bd8570-b024-4585-81c8-e9f5c496adce None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:01.570993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-32bd8570-b024-4585-81c8-e9f5c496adce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:01.585008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:01.636103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 30/59] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:01.660916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d87ba-fe79-47db-b224-f5fb4974a38d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:01.759722 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d87ba-fe79-47db-b224-f5fb4974a38d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:01.762704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:01.795040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa12b5-060d-452b-a4de-6f56d3abeb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:01.795874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa12b5-060d-452b-a4de-6f56d3abeb56 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:01.796136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa12b5-060d-452b-a4de-6f56d3abeb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:01.796411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa12b5-060d-452b-a4de-6f56d3abeb56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:01.797638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa12b5-060d-452b-a4de-6f56d3abeb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:01.799090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa12b5-060d-452b-a4de-6f56d3abeb56 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:01.800723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 30/60] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:01.806228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd8570-b024-4585-81c8-e9f5c496adce None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:01.901480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd8570-b024-4585-81c8-e9f5c496adce None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:01.935169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c22fd8-6925-4a58-aec7-24d3ada51000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:01.935868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c22fd8-6925-4a58-aec7-24d3ada51000 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:01.936233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c22fd8-6925-4a58-aec7-24d3ada51000 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:01.936519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c22fd8-6925-4a58-aec7-24d3ada51000 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:01.937230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c22fd8-6925-4a58-aec7-24d3ada51000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:01.938689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c22fd8-6925-4a58-aec7-24d3ada51000 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:01.963799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 31/61] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:46:01 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:05.395281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4ec5-436a-4895-8ffa-5304a4546049 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.395793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4ec5-436a-4895-8ffa-5304a4546049 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.395864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4ec5-436a-4895-8ffa-5304a4546049 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.397255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 31/62] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:05.412082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843afd9-dd3c-4e75-a9a7-618b73bbb4ee None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.412559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843afd9-dd3c-4e75-a9a7-618b73bbb4ee None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.412744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843afd9-dd3c-4e75-a9a7-618b73bbb4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.426740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:05.434018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3843afd9-dd3c-4e75-a9a7-618b73bbb4ee None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:05.436551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3843afd9-dd3c-4e75-a9a7-618b73bbb4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:05.535125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 32/63] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:05.573160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4ec5-436a-4895-8ffa-5304a4546049 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:05.689329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df523-f808-4a18-a884-0aa43b563a59 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.689626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df523-f808-4a18-a884-0aa43b563a59 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.689914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df523-f808-4a18-a884-0aa43b563a59 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.691321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 33/64] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:05.696569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8265-368d-46a3-902f-27e3e8fa239d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.697141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8265-368d-46a3-902f-27e3e8fa239d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.697791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8265-368d-46a3-902f-27e3e8fa239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.718031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4ec5-436a-4895-8ffa-5304a4546049 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:05.720153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f23b8265-368d-46a3-902f-27e3e8fa239d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:05.722406 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f23b8265-368d-46a3-902f-27e3e8fa239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:05.773444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1349247-42d7-4152-9895-c58b1e00d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:05.774613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1349247-42d7-4152-9895-c58b1e00d51e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.774965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1349247-42d7-4152-9895-c58b1e00d51e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.775313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1349247-42d7-4152-9895-c58b1e00d51e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.796296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1349247-42d7-4152-9895-c58b1e00d51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d1349247-42d7-4152-9895-c58b1e00d51e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:05.806611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:05.807686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:05.809518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:05.810247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 32/65] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:05.812281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e021-c5db-4210-a7f6-758031b82191 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.812645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e021-c5db-4210-a7f6-758031b82191 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.813001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e021-c5db-4210-a7f6-758031b82191 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.814659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 33/66] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:05.816570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e021-c5db-4210-a7f6-758031b82191 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:05.827893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 34/67] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:05.829586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87506383-61fc-4090-93b6-509523af38e5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.830075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87506383-61fc-4090-93b6-509523af38e5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.830661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87506383-61fc-4090-93b6-509523af38e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.849030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-87506383-61fc-4090-93b6-509523af38e5 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:05.850538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-87506383-61fc-4090-93b6-509523af38e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:05.852218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:05.931079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:05.940434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e021-c5db-4210-a7f6-758031b82191 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:05.941665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 35/68] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:05.943655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87506383-61fc-4090-93b6-509523af38e5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:05.989501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c650e-df7b-4d38-82c6-f809492f8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:05.990188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c650e-df7b-4d38-82c6-f809492f8684 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:05.990481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c650e-df7b-4d38-82c6-f809492f8684 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:05.990766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c650e-df7b-4d38-82c6-f809492f8684 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:05.991537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c650e-df7b-4d38-82c6-f809492f8684 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:05.991855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c650e-df7b-4d38-82c6-f809492f8684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:05.993288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c650e-df7b-4d38-82c6-f809492f8684 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:06.008052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:06.008052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfba58-0df2-486d-a8c2-4989820e4608 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.008297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfba58-0df2-486d-a8c2-4989820e4608 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.008567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfba58-0df2-486d-a8c2-4989820e4608 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.012081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 35/70] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:06.013995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfba58-0df2-486d-a8c2-4989820e4608 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.062531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87506383-61fc-4090-93b6-509523af38e5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.100917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.101734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.102030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.102315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.113588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:06.116658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:06.122545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:06.123603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:06.124429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 36/71] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:06.125030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.131311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfba58-0df2-486d-a8c2-4989820e4608 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.168373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362d5dd-2225-4aea-ba27-9e99cc9b6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.169178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362d5dd-2225-4aea-ba27-9e99cc9b6d1d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.169470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362d5dd-2225-4aea-ba27-9e99cc9b6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.169751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362d5dd-2225-4aea-ba27-9e99cc9b6d1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.180126 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362d5dd-2225-4aea-ba27-9e99cc9b6d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:06.186087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e362d5dd-2225-4aea-ba27-9e99cc9b6d1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:06.188752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:06.189598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:06.190358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 36/72] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:06.191490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494165-22ba-4fb3-95bb-5bb9a9e7f9c8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.191490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494165-22ba-4fb3-95bb-5bb9a9e7f9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.191744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494165-22ba-4fb3-95bb-5bb9a9e7f9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.208289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-32494165-22ba-4fb3-95bb-5bb9a9e7f9c8 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:06.209505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-32494165-22ba-4fb3-95bb-5bb9a9e7f9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:06.237221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289cc94-6c10-4fa5-ae4c-a3ca048fd474 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.270629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea238b0-e49f-49e3-b2d0-738ce16027cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.271503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea238b0-e49f-49e3-b2d0-738ce16027cb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.271795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea238b0-e49f-49e3-b2d0-738ce16027cb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.272101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea238b0-e49f-49e3-b2d0-738ce16027cb None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.279082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 37/73] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:06.279936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32494165-22ba-4fb3-95bb-5bb9a9e7f9c8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.293489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea238b0-e49f-49e3-b2d0-738ce16027cb None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:06.294982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea238b0-e49f-49e3-b2d0-738ce16027cb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:06.300982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 37/74] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:06.300982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eadf24-f11e-47f0-beba-00fa62c1f6ee None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.300982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eadf24-f11e-47f0-beba-00fa62c1f6ee None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.300982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eadf24-f11e-47f0-beba-00fa62c1f6ee None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.300982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 38/75] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:06.300982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eadf24-f11e-47f0-beba-00fa62c1f6ee None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.368839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.386690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32494165-22ba-4fb3-95bb-5bb9a9e7f9c8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.406581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eadf24-f11e-47f0-beba-00fa62c1f6ee None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.420651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.422286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.423213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.423503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.423779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.424568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:06.424880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:06.426278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:06.435256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 38/76] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:06.436083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.442541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.443157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.443445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.443725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.444511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:06.444820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:06.446213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:06.459275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 39/77] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:06.459275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.540369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6af27b-ace3-4ff2-8874-a862b51f799d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.555402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653559e-04c5-4910-925a-bbf9bef4ff00 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.573098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.574458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.574780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.575062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.590501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.591921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa5013-5251-44e8-b8ba-8d7b97c6ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.592860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa5013-5251-44e8-b8ba-8d7b97c6ce79 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.593147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa5013-5251-44e8-b8ba-8d7b97c6ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.593432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa5013-5251-44e8-b8ba-8d7b97c6ce79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.603715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa5013-5251-44e8-b8ba-8d7b97c6ce79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4cfa5013-5251-44e8-b8ba-8d7b97c6ce79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:06.611795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:06.612693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:06.613428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 40/78] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:06.614374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb7637-0e4a-4e18-958b-488e6d4617b4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.614534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb7637-0e4a-4e18-958b-488e6d4617b4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.614820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb7637-0e4a-4e18-958b-488e6d4617b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.631774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a1fb7637-0e4a-4e18-958b-488e6d4617b4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:06.633029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a1fb7637-0e4a-4e18-958b-488e6d4617b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:06.644358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:06.645815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:06.662354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.707605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 41/79] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:06.707605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb7637-0e4a-4e18-958b-488e6d4617b4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.758772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 39/80] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:06.759631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.811315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.829117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb7637-0e4a-4e18-958b-488e6d4617b4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.869548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a893f-f673-4712-80d0-3664c31cd4fc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:06.874205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.875094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.875379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.875656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.876898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:06.878365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:06.880029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 42/81] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:06.880800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.905887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:06.906773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:06.907061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:06.907346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] PATH_INFO: `/v3/users/c2a69d3812404e20840e7bb0da9d4d1a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:06.908577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a69d3812404e20840e7bb0da9d4d1a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:06.910056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:06.911733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 40/82] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/users/c2a69d3812404e20840e7bb0da9d4d1a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:06.912567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:06.920579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:06.990916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b1b07-091d-434c-80d2-7cc7be24326f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.024708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163d7c-4ab1-4b4a-a82a-a4718f89d274 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.027805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.028511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.028801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.029076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.029827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:07.030140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.031526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.045326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 43/83] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:07.045489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.045577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.066841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.067647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.067942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.068247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.069462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.070935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.072632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 41/84] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:07.073402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.143296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.149645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d809fe-8485-47e1-97a5-77679e042650 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.173220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ece58-eb66-4a75-be15-f526d58e459f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.183909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.184846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.185137 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.185507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.186761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.188254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.190022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 44/85] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:07.190841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.209994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.210651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.210946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.211230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.262198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.282365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.283877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.291253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad787c-56e3-4024-ad65-9b8ee95b1e44 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.324818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.325475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.325774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.326057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.359131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.384776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 42/86] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:07.385652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.398554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.400311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.481312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.500633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882af1-1138-4688-a38e-df4e541e0208 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.503254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 45/87] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:07.505004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.537572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.539506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.539506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.539506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.540203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.541684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.544229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 43/88] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:07.545012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.566454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.604179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dbf7a-ffcb-4402-9482-8b3d03c0ece6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.638018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.638696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.638990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.639273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.639987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.641458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.644527 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7131faa-b1ba-4c80-b5fa-25585d5fe4ed None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.661494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 46/89] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:46:07 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:07.662317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.697941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.699454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.699857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.700176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.701066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=72e4b3d78f46430da67a9fbd46755937) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:07.701383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.702892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.708997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 44/90] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/role_assignments?user.id=72e4b3d78f46430da67a9fbd46755937&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=2e54f04264af40db9d9999111f07233f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:07.708997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.737286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.844259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a175-3618-42f6-9199-cd7215cccb86 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.856770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c108e7-86f1-4500-80ed-354d9130044b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:07.878903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:07.902442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.903672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.904298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.905155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.906563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.908417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.910816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 47/91] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:07.912868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:07.919679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:07.920708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:07.920990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:07.921271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:07.922610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:07.924122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:07.926886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 45/92] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:07.927744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:08.044752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:08.047739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a7b2-0c30-4fad-b501-d7a9b3db247b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:08.069537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58877-6728-4392-b426-0a38078d0ef2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:08.096769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:08.097367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:08.097751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:08.097934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:08.110303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:08.111344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:08.111833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:08.112341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:08.113406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] RBAC: Adding query filter params (role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=72e4b3d78f46430da67a9fbd46755937) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:08.113948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:08.115633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:08.126383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 46/93] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/role_assignments?user.id=72e4b3d78f46430da67a9fbd46755937&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:08.127650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:08.173441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:08.174955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:08.204500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:08.245044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928c698-df09-4508-806b-9bd8cee723ef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:08.287200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:08.288301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:08.288818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:08.289299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:08.290371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=c2a69d3812404e20840e7bb0da9d4d1a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:08.290898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:08.292735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:08.299610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 47/94] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:08 2022] GET /identity/v3/role_assignments?user.id=c2a69d3812404e20840e7bb0da9d4d1a&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:08.351794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 48/95] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:08.358363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:08.380517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:08.509160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927c69-231a-469a-8015-8a01fb61c6b7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:08.560472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce0eb2-c59f-4efd-95b4-a494fce98712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:08.561784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce0eb2-c59f-4efd-95b4-a494fce98712 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:08.562272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce0eb2-c59f-4efd-95b4-a494fce98712 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:08.562787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce0eb2-c59f-4efd-95b4-a494fce98712 None admin] PATH_INFO: `/v3/projects/6e2ed20dee9949799c84be5ef7040043` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:08.565742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce0eb2-c59f-4efd-95b4-a494fce98712 None admin] RBAC: Authorizing `identity:get_project(project_id=6e2ed20dee9949799c84be5ef7040043)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:08.567576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce0eb2-c59f-4efd-95b4-a494fce98712 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:08.570698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 48/96] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:08 2022] GET /identity/v3/projects/6e2ed20dee9949799c84be5ef7040043 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:08.575693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:08.697905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:08.718169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4ce5-4235-4ef7-b282-dd7decee78c0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:08.759119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de796bde-b902-470c-bcf2-af0757c3604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:08.759807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de796bde-b902-470c-bcf2-af0757c3604a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:08.760122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de796bde-b902-470c-bcf2-af0757c3604a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:08.760408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de796bde-b902-470c-bcf2-af0757c3604a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:08.761317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de796bde-b902-470c-bcf2-af0757c3604a None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=6e2ed20dee9949799c84be5ef7040043, user.id=72e4b3d78f46430da67a9fbd46755937) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:08.761641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de796bde-b902-470c-bcf2-af0757c3604a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:08.763121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de796bde-b902-470c-bcf2-af0757c3604a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:08.769588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 49/97] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:08 2022] GET /identity/v3/role_assignments?user.id=72e4b3d78f46430da67a9fbd46755937&scope.project.id=6e2ed20dee9949799c84be5ef7040043&role.id=2e54f04264af40db9d9999111f07233f => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:10.708822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3364-dcb6-48c7-b9f4-8cbf8dfa83e2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:10.709461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3364-dcb6-48c7-b9f4-8cbf8dfa83e2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:10.709461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3364-dcb6-48c7-b9f4-8cbf8dfa83e2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:10.710792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 49/98] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:10.721933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd404-cfaa-47a2-b790-d86008e7969d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:10.722459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd404-cfaa-47a2-b790-d86008e7969d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:10.722537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd404-cfaa-47a2-b790-d86008e7969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:10.741592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-edabd404-cfaa-47a2-b790-d86008e7969d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:10.742780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-edabd404-cfaa-47a2-b790-d86008e7969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:10.838635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 50/99] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:10.874002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf3364-dcb6-48c7-b9f4-8cbf8dfa83e2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:10.916511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cd2c7-15ec-485d-8d42-8d30c92759ff None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:10.916831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cd2c7-15ec-485d-8d42-8d30c92759ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:10.918007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cd2c7-15ec-485d-8d42-8d30c92759ff None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:10.922471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 51/100] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:46:10.929522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb82b8-b9c5-43bc-a0be-0302f534d808 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:10.929833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb82b8-b9c5-43bc-a0be-0302f534d808 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:10.930087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb82b8-b9c5-43bc-a0be-0302f534d808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:10.960147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-edbb82b8-b9c5-43bc-a0be-0302f534d808 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:10.961271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-edbb82b8-b9c5-43bc-a0be-0302f534d808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:11.030119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:11.078503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf3364-dcb6-48c7-b9f4-8cbf8dfa83e2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:11.102269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 52/101] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:11.138323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:11.139151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.139438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.139715 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.149839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb82b8-b9c5-43bc-a0be-0302f534d808 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:11.169407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:11.169798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:11.188799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:11.189751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:11.190534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 50/102] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:11.199014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:11.296775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb82b8-b9c5-43bc-a0be-0302f534d808 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:11.345355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:11.346175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.346499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.346783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.370446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:11.387146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:11.388112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:11.388864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:11.389455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 53/103] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:11.396812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:11.454293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed069545-7269-40cd-8b41-85f03b839857 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:11.516127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:11.536742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:11.537503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.537789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.538279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.539187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:11.539639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:11.541263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:11.550984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a59e-31c5-4f55-bb05-09a541c22b08 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:11.554613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 51/104] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:11.555166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:11.563086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:11.599079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10302d8c-eae2-4b78-9f28-8f776b832cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:11.599748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302d8c-eae2-4b78-9f28-8f776b832cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.600071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302d8c-eae2-4b78-9f28-8f776b832cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.601321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302d8c-eae2-4b78-9f28-8f776b832cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.601321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10302d8c-eae2-4b78-9f28-8f776b832cb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:11.601486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10302d8c-eae2-4b78-9f28-8f776b832cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:11.603159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10302d8c-eae2-4b78-9f28-8f776b832cb8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:11.614495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 54/105] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:11.616430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154485-a8a9-428d-8066-03095dedc320 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.616899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154485-a8a9-428d-8066-03095dedc320 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.617374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154485-a8a9-428d-8066-03095dedc320 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.619366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 55/106] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:11.622396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9aafd-a2a1-4c4d-821e-afce96d80fac None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.622903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9aafd-a2a1-4c4d-821e-afce96d80fac None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.623334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9aafd-a2a1-4c4d-821e-afce96d80fac None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.625476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 56/107] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:11.630915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9aafd-a2a1-4c4d-821e-afce96d80fac None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:11.676755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e750-50fb-4b6a-8a3f-ba205e962d2a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:11.711450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf427c-a0d7-4b3f-9317-86f8693a5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:11.712369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf427c-a0d7-4b3f-9317-86f8693a5669 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.712656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf427c-a0d7-4b3f-9317-86f8693a5669 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.712936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf427c-a0d7-4b3f-9317-86f8693a5669 None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.714745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf427c-a0d7-4b3f-9317-86f8693a5669 None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:11.716268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf427c-a0d7-4b3f-9317-86f8693a5669 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:11.719073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 52/108] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:11.720351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f91c7-b243-4735-ad66-8c4bd00b1db4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.720846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f91c7-b243-4735-ad66-8c4bd00b1db4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.721267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f91c7-b243-4735-ad66-8c4bd00b1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.738686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-617f91c7-b243-4735-ad66-8c4bd00b1db4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:11.740276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-617f91c7-b243-4735-ad66-8c4bd00b1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:11.753833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9aafd-a2a1-4c4d-821e-afce96d80fac None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:11.795927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dee1c-037c-4f70-99ba-3a8b2ab8d04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:11.796856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dee1c-037c-4f70-99ba-3a8b2ab8d04e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.797145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dee1c-037c-4f70-99ba-3a8b2ab8d04e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.797428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dee1c-037c-4f70-99ba-3a8b2ab8d04e None admin] PATH_INFO: `/v3/users/5dbe4f308af7454c9b6fe6bc767008f4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.799611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:11.813344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dee1c-037c-4f70-99ba-3a8b2ab8d04e None admin] RBAC: Authorizing `identity:get_user(user_id=5dbe4f308af7454c9b6fe6bc767008f4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:11.814808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:11.815618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dee1c-037c-4f70-99ba-3a8b2ab8d04e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:11.817657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 57/109] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/users/5dbe4f308af7454c9b6fe6bc767008f4 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:11.818810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96495a6-569c-4bc8-b0ab-d9ee7cc67011 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.819494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96495a6-569c-4bc8-b0ab-d9ee7cc67011 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.820285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96495a6-569c-4bc8-b0ab-d9ee7cc67011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.822388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 53/110] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:11.823298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f91c7-b243-4735-ad66-8c4bd00b1db4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:11.844986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d96495a6-569c-4bc8-b0ab-d9ee7cc67011 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:11.846346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d96495a6-569c-4bc8-b0ab-d9ee7cc67011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:11.914320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 58/111] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:11.915191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96495a6-569c-4bc8-b0ab-d9ee7cc67011 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:11.929987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f91c7-b243-4735-ad66-8c4bd00b1db4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:11.973270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb3f10-4937-4f15-8276-19ac0661dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:11.974396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb3f10-4937-4f15-8276-19ac0661dfdb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.974689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb3f10-4937-4f15-8276-19ac0661dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.975433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb3f10-4937-4f15-8276-19ac0661dfdb None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.976921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb3f10-4937-4f15-8276-19ac0661dfdb None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:11.979115 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb3f10-4937-4f15-8276-19ac0661dfdb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:11.985596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 54/112] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:11.985596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af1f6-0971-4b3f-ad4f-55d39faaf92f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:11.985596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af1f6-0971-4b3f-ad4f-55d39faaf92f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:11.985596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af1f6-0971-4b3f-ad4f-55d39faaf92f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:11.985596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 55/113] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:11.986277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af1f6-0971-4b3f-ad4f-55d39faaf92f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.040133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96495a6-569c-4bc8-b0ab-d9ee7cc67011 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.067935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.070878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.081783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.082654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.083111 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.083666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.113719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af1f6-0971-4b3f-ad4f-55d39faaf92f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.155562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.157185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.157307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.158047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.158336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.158617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.174120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:12.181930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:12.183096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:12.183948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 56/114] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:12.184631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.276043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 59/115] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:12.277949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.304685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.306394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcad63f-2c44-4cfc-af5d-659c279fe136 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.335328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.346044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c46b8-08a5-4b8e-a526-353f639ae140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.346868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c46b8-08a5-4b8e-a526-353f639ae140 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.347350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c46b8-08a5-4b8e-a526-353f639ae140 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.347456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c46b8-08a5-4b8e-a526-353f639ae140 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.358840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c46b8-08a5-4b8e-a526-353f639ae140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-797c46b8-08a5-4b8e-a526-353f639ae140 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:12.367057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:12.368082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:12.369016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 57/116] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:12.369795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba46f-c3a2-43f3-884d-33c71802d047 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.369795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba46f-c3a2-43f3-884d-33c71802d047 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.370297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba46f-c3a2-43f3-884d-33c71802d047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.390264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0f4ba46f-c3a2-43f3-884d-33c71802d047 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:12.391497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f4ba46f-c3a2-43f3-884d-33c71802d047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:12.399829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205c7e-06e7-43f0-b5bc-2ff59ebabb87 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.433609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.434500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.434781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.435061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/72e4b3d78f46430da67a9fbd46755937/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.437055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e270cff1485142ceb7dfa49f549bcc09, user_id=72e4b3d78f46430da67a9fbd46755937, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.438548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.451175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 60/117] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:12 2022] PUT /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/72e4b3d78f46430da67a9fbd46755937/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:12.464735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.464869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 58/118] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:12.464869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba46f-c3a2-43f3-884d-33c71802d047 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.557422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.577200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba46f-c3a2-43f3-884d-33c71802d047 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.581953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afda00-e785-4899-980f-b8eb28e544a3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.598964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.619731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.620836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.621124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.621406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.622642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.623259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d71696-b8ea-4986-bc4d-04fe893102e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.623946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d71696-b8ea-4986-bc4d-04fe893102e4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.624196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.624293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d71696-b8ea-4986-bc4d-04fe893102e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.624530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d71696-b8ea-4986-bc4d-04fe893102e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.625300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d71696-b8ea-4986-bc4d-04fe893102e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:12.625611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d71696-b8ea-4986-bc4d-04fe893102e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.626282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 59/119] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:12.626854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.627003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d71696-b8ea-4986-bc4d-04fe893102e4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.642643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 61/120] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:12.644228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409441-c8c6-4daf-994c-e2cb1e935e0f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.644525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409441-c8c6-4daf-994c-e2cb1e935e0f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.644805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61409441-c8c6-4daf-994c-e2cb1e935e0f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.646071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 62/121] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:12.646831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61409441-c8c6-4daf-994c-e2cb1e935e0f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.749497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b8edb-6d22-4054-abdc-ae1fc29c66ce None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.766747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61409441-c8c6-4daf-994c-e2cb1e935e0f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.789946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.790899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.791190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.791482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.793978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:12.794289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.795713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.804461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 60/122] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:12.804607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.805573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.805931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.806282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.807625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.809154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.809357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.811325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 63/123] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:12.812955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.829038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.866146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:12.925679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30f23c-7110-4b89-9494-39f763952630 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.926169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebac6-fc49-4837-ad2c-8b38807b120e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:12.963900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.964530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e75a-739d-4499-bf0a-506ecf9fbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:12.964626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.964881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.965132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e75a-739d-4499-bf0a-506ecf9fbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.965234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.965430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e75a-739d-4499-bf0a-506ecf9fbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.965712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e75a-739d-4499-bf0a-506ecf9fbcd6 None admin] PATH_INFO: `/v3/users/c2a69d3812404e20840e7bb0da9d4d1a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.966152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] RBAC: Adding query filter params (role.id=c4f44a11e6224a609539553c6462d0cc, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=5dbe4f308af7454c9b6fe6bc767008f4) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:12.966475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.967012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034e75a-739d-4499-bf0a-506ecf9fbcd6 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a69d3812404e20840e7bb0da9d4d1a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:12.967948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.968500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034e75a-739d-4499-bf0a-506ecf9fbcd6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:12.970314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 64/124] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/users/c2a69d3812404e20840e7bb0da9d4d1a => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:12.974012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 61/125] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/role_assignments?user.id=5dbe4f308af7454c9b6fe6bc767008f4&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=c4f44a11e6224a609539553c6462d0cc => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:12.975684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db001dc-81cb-4a2c-a157-39e903234e8e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:12.975979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db001dc-81cb-4a2c-a157-39e903234e8e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:12.976286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db001dc-81cb-4a2c-a157-39e903234e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:12.985118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:12.996173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8db001dc-81cb-4a2c-a157-39e903234e8e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:12.997442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8db001dc-81cb-4a2c-a157-39e903234e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:13.078708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 65/126] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:13.079721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db001dc-81cb-4a2c-a157-39e903234e8e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.093053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:13.126814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057fdf3-4cde-41aa-b12f-d01f08b771b1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.140466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:13.168923 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.169987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.170375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.171184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.172413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:13.174161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:13.176137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 62/127] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:12 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:13.180882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.199908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db001dc-81cb-4a2c-a157-39e903234e8e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.242610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.243405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.243764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.244141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.244941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:13.246662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:13.279524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 66/128] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:46:13 2022] POST /identity/v3/projects => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:13.280644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.332551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e9ae4-bbd5-4610-bf66-b9daf4b632d7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.374422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:13.379009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8071f-d720-4122-abba-9167357847be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.380172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8071f-d720-4122-abba-9167357847be None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.380479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8071f-d720-4122-abba-9167357847be None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.380768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8071f-d720-4122-abba-9167357847be None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.382457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8071f-d720-4122-abba-9167357847be None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:13.384226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8071f-d720-4122-abba-9167357847be None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:13.386562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 63/129] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:13 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:13.387395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8071f-d720-4122-abba-9167357847be None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.429351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616a5a0-b2c4-48a1-9045-d6b0bfb1b4d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.453811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:13.469613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.470784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.471303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.471786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.490223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:13.499261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:13.500218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:13.501229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:13.503386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 67/130] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:13.504405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.518610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8071f-d720-4122-abba-9167357847be None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.558351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.559766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.559884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.560308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.561697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:13.563277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:13.565218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 64/131] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:13 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:13.566170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.659271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568f6f-f593-4295-a4a6-95c64a0bd3d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.688410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:13.692799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788067e-b0ad-4d63-866c-169d5e5698fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.706718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.708175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.708783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.709417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:13.710165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/c2a69d3812404e20840e7bb0da9d4d1a/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.713840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] RBAC: Authorizing `identity:create_grant(project_id=e270cff1485142ceb7dfa49f549bcc09, user_id=c2a69d3812404e20840e7bb0da9d4d1a, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:13.716180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:13.738730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.739108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 68/132] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:13 2022] PUT /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/c2a69d3812404e20840e7bb0da9d4d1a/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:13.739395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.739687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.739974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.740776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:13.741093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:13.741497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.742503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:13.766545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 65/133] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:13.772128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:13.874127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd330f-3fc2-4090-9e11-72509a50ecab None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:13.922284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:13.923210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:13.923504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:13.923789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/72e4b3d78f46430da67a9fbd46755937/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:13.931263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e270cff1485142ceb7dfa49f549bcc09, user_id=72e4b3d78f46430da67a9fbd46755937, role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:13.933022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:13.963865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 69/134] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:13 2022] PUT /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/72e4b3d78f46430da67a9fbd46755937/roles/cdcd22caf11c40b490d53fab54878c23 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:14.025551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b184-5ccf-4800-a27b-368b31d95464 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:14.075693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:14.077201 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:14.077717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:14.078238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:14.079760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:14.081719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:14.084063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 66/135] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:13 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:14.089452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:14.150522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:14.233159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0153178-cca0-41c0-9950-ec98863769a9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:14.276142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fad3e1-c18b-43c6-810d-51294f1789e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:14.277239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fad3e1-c18b-43c6-810d-51294f1789e1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:14.277529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fad3e1-c18b-43c6-810d-51294f1789e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:14.277812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fad3e1-c18b-43c6-810d-51294f1789e1 None admin] PATH_INFO: `/v3/projects/6e2ed20dee9949799c84be5ef7040043` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:14.279097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fad3e1-c18b-43c6-810d-51294f1789e1 None admin] RBAC: Authorizing `identity:get_project(project_id=6e2ed20dee9949799c84be5ef7040043)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:14.280699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fad3e1-c18b-43c6-810d-51294f1789e1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:14.282779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 70/136] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:14 2022] GET /identity/v3/projects/6e2ed20dee9949799c84be5ef7040043 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:14.288237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:14.356323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:14.423897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac6ff-fed2-421e-a7fa-d00beabc5b07 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:14.462102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf7711-e9e5-4de3-be43-7372f91d753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:14.463360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7711-e9e5-4de3-be43-7372f91d753c None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:14.463902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7711-e9e5-4de3-be43-7372f91d753c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:14.464401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7711-e9e5-4de3-be43-7372f91d753c None admin] PATH_INFO: `/v3/projects/6e2ed20dee9949799c84be5ef7040043/users/72e4b3d78f46430da67a9fbd46755937/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:14.466703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf7711-e9e5-4de3-be43-7372f91d753c None admin] RBAC: Authorizing `identity:create_grant(project_id=6e2ed20dee9949799c84be5ef7040043, user_id=72e4b3d78f46430da67a9fbd46755937, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:14.472504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf7711-e9e5-4de3-be43-7372f91d753c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:14.491222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 67/137] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:14 2022] PUT /identity/v3/projects/6e2ed20dee9949799c84be5ef7040043/users/72e4b3d78f46430da67a9fbd46755937/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:15.598126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3484e-0c2c-41df-90ec-8d991d6c0f67 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:15.598640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3484e-0c2c-41df-90ec-8d991d6c0f67 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:15.598751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3484e-0c2c-41df-90ec-8d991d6c0f67 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:15.600255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 71/138] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:15.606283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca559-2813-42dd-81c2-600eb2ef0e3b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:15.607073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca559-2813-42dd-81c2-600eb2ef0e3b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:15.607367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca559-2813-42dd-81c2-600eb2ef0e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:15.607999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5d993-c40d-458f-bb0d-4470521f8ac8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:15.608323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5d993-c40d-458f-bb0d-4470521f8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:15.608612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5d993-c40d-458f-bb0d-4470521f8ac8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:15.610049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 72/139] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:15.615291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53c95-ca52-4e9d-8169-338a989c6db9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:15.615590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53c95-ca52-4e9d-8169-338a989c6db9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:15.615878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53c95-ca52-4e9d-8169-338a989c6db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:15.630653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9b8ca559-2813-42dd-81c2-600eb2ef0e3b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:15.632271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b8ca559-2813-42dd-81c2-600eb2ef0e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:15.645237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e3c53c95-ca52-4e9d-8169-338a989c6db9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:15.646549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e3c53c95-ca52-4e9d-8169-338a989c6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:15.806312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 68/140] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:15.841338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca559-2813-42dd-81c2-600eb2ef0e3b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:15.845608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 73/141] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:15.880267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:15.888444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53c95-ca52-4e9d-8169-338a989c6db9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:15.966642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca559-2813-42dd-81c2-600eb2ef0e3b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:15.988372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:16.012565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:16.013376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:16.013665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:16.013948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:16.040646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:16.063550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:16.064475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:16.065230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 69/142] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:16.071271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:16.129674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53c95-ca52-4e9d-8169-338a989c6db9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:16.200908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:16.201729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:16.202015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:16.202294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:16.223199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:16.231405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:16.232280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:16.233017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:16.235125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 74/143] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:16.248818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:16.278729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:16.294638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9002-c185-4a57-8a22-9cba557c312e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:16.333015 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:16.333711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:16.333999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:16.334282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:16.335172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:16.335505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:16.337047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:16.348895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 70/144] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:16.355877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:16.375437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:16.379363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021bc35-a625-43a7-9ae3-894b29f93338 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:16.427384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:16.428321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:16.428751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:16.429201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:16.430096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:16.430571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:16.434149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:16.445851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 75/145] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:16.453249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:16.535845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99def2fc-1208-40e7-a5b6-da3b144547a4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:16.640789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:16.641687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:16.641977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:16.642257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] PATH_INFO: `/v3/users/5dbe4f308af7454c9b6fe6bc767008f4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:16.644284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] RBAC: Authorizing `identity:get_user(user_id=5dbe4f308af7454c9b6fe6bc767008f4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:16.645788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:16.647468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 71/146] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:16 2022] GET /identity/v3/users/5dbe4f308af7454c9b6fe6bc767008f4 => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:16.654653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:16.689287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707469-f0d3-4d8a-a65a-e06e44a76f01 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:16.695222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:16.787181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:16.788143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:16.788440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:16.788721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:16.790345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfdcfb-3d5c-429a-95a8-a78012669118 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:16.792917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:16.794390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:16.796450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 76/147] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:16 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:16.801843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:16.831717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:16.832625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:16.833210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:16.833490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:16.834976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:16.836487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:16.838592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 72/148] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:16 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:16.844042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:16.875531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:16.972308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:16.977541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea70a4-2da1-4129-b53e-7075185f2b2e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:17.013291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1c4f-e6d7-4b38-9494-596ad4fb729a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:17.013610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba238d22-32b7-4c0a-88d3-80fceda5b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:17.014533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238d22-32b7-4c0a-88d3-80fceda5b6f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.014819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238d22-32b7-4c0a-88d3-80fceda5b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.015096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238d22-32b7-4c0a-88d3-80fceda5b6f7 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/5dbe4f308af7454c9b6fe6bc767008f4/roles/c4f44a11e6224a609539553c6462d0cc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.017491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba238d22-32b7-4c0a-88d3-80fceda5b6f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e270cff1485142ceb7dfa49f549bcc09, user_id=5dbe4f308af7454c9b6fe6bc767008f4, role_id=c4f44a11e6224a609539553c6462d0cc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:17.018634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba238d22-32b7-4c0a-88d3-80fceda5b6f7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:17.039409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 73/149] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:16 2022] PUT /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09/users/5dbe4f308af7454c9b6fe6bc767008f4/roles/c4f44a11e6224a609539553c6462d0cc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:46:17.040696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7e9a0-9481-4bfe-9b43-e85a8a316da5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.040997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7e9a0-9481-4bfe-9b43-e85a8a316da5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.041278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7e9a0-9481-4bfe-9b43-e85a8a316da5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.042771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 74/150] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:17.048356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13c5d-006d-4978-a9ac-6057ec7aa29e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.048668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13c5d-006d-4978-a9ac-6057ec7aa29e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.048919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13c5d-006d-4978-a9ac-6057ec7aa29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.089872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-74f13c5d-006d-4978-a9ac-6057ec7aa29e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:17.091154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-74f13c5d-006d-4978-a9ac-6057ec7aa29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:17.095088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934721b-f0ab-47a1-87b7-47e88de2ae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:17.095792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934721b-f0ab-47a1-87b7-47e88de2ae1c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.096106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934721b-f0ab-47a1-87b7-47e88de2ae1c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.096390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934721b-f0ab-47a1-87b7-47e88de2ae1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.256417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934721b-f0ab-47a1-87b7-47e88de2ae1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:17.257914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934721b-f0ab-47a1-87b7-47e88de2ae1c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:17.261625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 75/151] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:17.307824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13c5d-006d-4978-a9ac-6057ec7aa29e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:17.323189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:17.423841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:17.448530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13c5d-006d-4978-a9ac-6057ec7aa29e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:17.489821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 77/152] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:46:17.490226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:17.490474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.490763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.491041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.491224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e4c5-5722-4cb6-8c91-a2a47399744a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.491412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e4c5-5722-4cb6-8c91-a2a47399744a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.491899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e4c5-5722-4cb6-8c91-a2a47399744a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.493271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 78/153] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:17.500365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1ce6-beaf-455f-b020-0020ab47f6de None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.500636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1ce6-beaf-455f-b020-0020ab47f6de None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.500919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1ce6-beaf-455f-b020-0020ab47f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.504056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:17.512867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:17.514866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 76/154] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:17.517012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:17.529490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-21ea1ce6-beaf-455f-b020-0020ab47f6de None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:17.530849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-21ea1ce6-beaf-455f-b020-0020ab47f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:17.631499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac019b-21b4-4442-b669-f968bb776e50 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:17.651124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 79/155] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:17.652471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1ce6-beaf-455f-b020-0020ab47f6de None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:17.677291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48ab10-78cc-4eb5-b868-8a082c886a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:17.678171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ab10-78cc-4eb5-b868-8a082c886a1c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.678650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ab10-78cc-4eb5-b868-8a082c886a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.679202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48ab10-78cc-4eb5-b868-8a082c886a1c None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.680672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48ab10-78cc-4eb5-b868-8a082c886a1c None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:17.683067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48ab10-78cc-4eb5-b868-8a082c886a1c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:17.685728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 77/156] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:17 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:17.687426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505021f1-a542-4040-9b19-b66b1de47f28 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.687891 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505021f1-a542-4040-9b19-b66b1de47f28 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.688361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505021f1-a542-4040-9b19-b66b1de47f28 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.689800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 78/157] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:17.690948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505021f1-a542-4040-9b19-b66b1de47f28 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:17.706257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:17.734991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:17.835483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1ce6-beaf-455f-b020-0020ab47f6de None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:17.843621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505021f1-a542-4040-9b19-b66b1de47f28 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:17.885406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:17.887145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.887981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.888498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.890167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:17.892335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:17.894602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 79/158] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:17.895582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:17.908133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7608-e415-4539-8da4-b466e2373c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:17.909395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7608-e415-4539-8da4-b466e2373c7b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.909909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7608-e415-4539-8da4-b466e2373c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.910539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7608-e415-4539-8da4-b466e2373c7b None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.912233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7608-e415-4539-8da4-b466e2373c7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:17.912795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7608-e415-4539-8da4-b466e2373c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:17.915696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7608-e415-4539-8da4-b466e2373c7b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:17.932707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 80/159] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:17.940619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a54d4-d1ad-4723-98b7-587ef4876d41 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:17.941152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a54d4-d1ad-4723-98b7-587ef4876d41 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:17.941728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a54d4-d1ad-4723-98b7-587ef4876d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:17.974835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7e5a54d4-d1ad-4723-98b7-587ef4876d41 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:17.977010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7e5a54d4-d1ad-4723-98b7-587ef4876d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:17.989801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:18.016325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1724-2829-45ba-ac5a-615ffc33a45f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:18.070896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 81/160] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:18.072508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a54d4-d1ad-4723-98b7-587ef4876d41 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.078112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:18.078786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.079073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.079359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.088197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=72e4b3d78f46430da67a9fbd46755937) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:18.088197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:18.088197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:18.094093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 80/161] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:17 2022] GET /identity/v3/role_assignments?user.id=72e4b3d78f46430da67a9fbd46755937&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=2e54f04264af40db9d9999111f07233f => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:18.095219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.133073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:18.187882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a54d4-d1ad-4723-98b7-587ef4876d41 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:18.230794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeee6d7-31d9-4aaa-9409-39ac537041d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:18.231551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee6d7-31d9-4aaa-9409-39ac537041d4 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.231767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee6d7-31d9-4aaa-9409-39ac537041d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.232072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee6d7-31d9-4aaa-9409-39ac537041d4 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.232813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeee6d7-31d9-4aaa-9409-39ac537041d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:18.234769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeee6d7-31d9-4aaa-9409-39ac537041d4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:18.237893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e697c-7ad0-4f49-bf9b-c3f6f7416d26 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:18.264047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 82/162] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:46:18 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:18.264047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76a0b-88a8-460f-8b2c-dc8aa7e46f26 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.264047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76a0b-88a8-460f-8b2c-dc8aa7e46f26 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.264047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76a0b-88a8-460f-8b2c-dc8aa7e46f26 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.264047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 83/163] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:18.264047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76a0b-88a8-460f-8b2c-dc8aa7e46f26 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.298423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a83c2-144c-4198-90f0-b392aa026927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:18.299766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a83c2-144c-4198-90f0-b392aa026927 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.306878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a83c2-144c-4198-90f0-b392aa026927 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.308669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a83c2-144c-4198-90f0-b392aa026927 None admin] PATH_INFO: `/v3/users/c2a69d3812404e20840e7bb0da9d4d1a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.310407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a83c2-144c-4198-90f0-b392aa026927 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a69d3812404e20840e7bb0da9d4d1a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:18.312432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a83c2-144c-4198-90f0-b392aa026927 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:18.314588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 81/164] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:18 2022] GET /identity/v3/users/c2a69d3812404e20840e7bb0da9d4d1a => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:18.316041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162540-acb7-42ad-b7f2-f5e0fbad71df None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.316461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162540-acb7-42ad-b7f2-f5e0fbad71df None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.316903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162540-acb7-42ad-b7f2-f5e0fbad71df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.343098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-65162540-acb7-42ad-b7f2-f5e0fbad71df None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:18.344649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65162540-acb7-42ad-b7f2-f5e0fbad71df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:18.349644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:18.397250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76a0b-88a8-460f-8b2c-dc8aa7e46f26 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:18.412448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:18.436003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 82/165] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:18.438160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162540-acb7-42ad-b7f2-f5e0fbad71df None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.441161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:18.442135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.442405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.442733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.457329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:18.471164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:18.472140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:18.472892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:18.473734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 84/166] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:18.479629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.571851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162540-acb7-42ad-b7f2-f5e0fbad71df None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:18.615539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:18.616230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.616519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.617391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.620546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd7e0-f1ef-46cd-a560-86148f3b3e62 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:18.630386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:18.669927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:18.670993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.671288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.671566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.672441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:18.672753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:18.674696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:18.685360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 85/167] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:18.686546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.708439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:18.709865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:18.735403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:18.824885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216092e5-b4f3-474a-8358-32dfc8648a32 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:18.843475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 83/168] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:18.844285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.867198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:18.868170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:18.868457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:18.868729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:18.881307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:18.890192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:18.891203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:18.892441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:18.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 86/169] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:18.893879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:18.971485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fac06-aeed-4877-8965-fe8312964230 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.024764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:19.027922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.029014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.029307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.029669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.030971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.032548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:19.034747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 84/170] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:18 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:19.035539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:19.037682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047634-692b-4143-a03c-a0d1df2d1adf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.085345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.086290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.086503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.086781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.088031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.090135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:19.092448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 87/171] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:18 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:19.093003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:19.153702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a7f1d-b86f-48ef-8504-8f275a1b09c4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.164409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:19.194840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.195637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.196002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.196314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.197091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:19.197422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.199837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:19.207781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009340-90d8-42c3-841c-89c428fdbfdb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.209000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 85/172] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:19.214752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:19.248615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.249193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.249476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.249748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.305999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:19.328557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2ea49-0ff6-4cc3-8eaf-429fe8ad9678 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.367371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.368130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.368424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.368708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.370524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=c2a69d3812404e20840e7bb0da9d4d1a) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:19.370844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.372369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:19.379638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 86/173] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:19 2022] GET /identity/v3/role_assignments?user.id=c2a69d3812404e20840e7bb0da9d4d1a&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:19.380746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:19.440998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.442484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:19.444482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:19.503950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe73c-f747-435a-a013-12cedc3f724e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.566698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.567666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.567954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.568465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] PATH_INFO: `/v3/users/72e4b3d78f46430da67a9fbd46755937` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.569949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] RBAC: Authorizing `identity:get_user(user_id=72e4b3d78f46430da67a9fbd46755937)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.571660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:19.577965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 87/174] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:19 2022] GET /identity/v3/users/72e4b3d78f46430da67a9fbd46755937 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:19.584125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:19.634511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 88/175] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:19.640975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:19.746943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:19.794032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222b404-e755-42a1-80ff-d4b3824db7ec None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.798834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:19.828867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01e0fc-0138-430b-9fde-805199eb6a4f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:19.857540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964438-1d0c-4e3c-9bc6-c9db22aa330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.858213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964438-1d0c-4e3c-9bc6-c9db22aa330d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.858499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964438-1d0c-4e3c-9bc6-c9db22aa330d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.858779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964438-1d0c-4e3c-9bc6-c9db22aa330d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.881592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b9ee-e428-4142-b52e-8f0130f1f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:19.883324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b9ee-e428-4142-b52e-8f0130f1f38e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.883833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b9ee-e428-4142-b52e-8f0130f1f38e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.884357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b9ee-e428-4142-b52e-8f0130f1f38e None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.887098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b9ee-e428-4142-b52e-8f0130f1f38e None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.888839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b9ee-e428-4142-b52e-8f0130f1f38e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:19.895419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 89/176] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:19 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:19.897612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e219b9-1df8-49e4-9518-78f3267e4bae None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:19.898500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e219b9-1df8-49e4-9518-78f3267e4bae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:19.899200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e219b9-1df8-49e4-9518-78f3267e4bae None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:19.902185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 90/177] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:19.906586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e219b9-1df8-49e4-9518-78f3267e4bae None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:19.953528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964438-1d0c-4e3c-9bc6-c9db22aa330d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:19.955015 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964438-1d0c-4e3c-9bc6-c9db22aa330d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:20.056257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e219b9-1df8-49e4-9518-78f3267e4bae None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:20.092312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:20.100489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 88/178] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:20.102682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c60a-fea9-46b2-9c6a-4f08c7c0292b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:20.103295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c60a-fea9-46b2-9c6a-4f08c7c0292b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:20.103836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c60a-fea9-46b2-9c6a-4f08c7c0292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:20.104171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:20.104850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:20.105140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:20.105420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:20.106293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] RBAC: Adding query filter params (role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=72e4b3d78f46430da67a9fbd46755937) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:20.106608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:20.108130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:20.116447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 91/179] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:19 2022] GET /identity/v3/role_assignments?user.id=72e4b3d78f46430da67a9fbd46755937&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:20.117109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:20.125644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cc59c60a-fea9-46b2-9c6a-4f08c7c0292b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:20.127292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cc59c60a-fea9-46b2-9c6a-4f08c7c0292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:20.132428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:20.283024 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 89/180] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:20.324731 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8668d4-cba9-4d1d-b688-63f530dc34d5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:20.360283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c60a-fea9-46b2-9c6a-4f08c7c0292b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:20.387986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:20.389353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:20.389861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:20.390368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] PATH_INFO: `/v3/projects/6e2ed20dee9949799c84be5ef7040043` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:20.392073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] RBAC: Authorizing `identity:get_project(project_id=6e2ed20dee9949799c84be5ef7040043)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:20.394010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:20.400248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 92/181] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:20 2022] GET /identity/v3/projects/6e2ed20dee9949799c84be5ef7040043 => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:20.403880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:20.473769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:20.517134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bfe9a-648e-4ea5-bf74-12923a7a8f0b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:20.556355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:20.557180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:20.557402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:20.557736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:20.558599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=6e2ed20dee9949799c84be5ef7040043, user.id=72e4b3d78f46430da67a9fbd46755937) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:20.558968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:20.560602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:20.568608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 93/182] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:20 2022] GET /identity/v3/role_assignments?user.id=72e4b3d78f46430da67a9fbd46755937&scope.project.id=6e2ed20dee9949799c84be5ef7040043&role.id=2e54f04264af40db9d9999111f07233f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:20.616490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c60a-fea9-46b2-9c6a-4f08c7c0292b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:20.662736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:20.669519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:20.670340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:20.670622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:20.670898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:20.684353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:20.693787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:20.694724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:20.695514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 90/183] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:20.702066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:20.829365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138699a-a452-40cf-91fa-a5474cbb8bda None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:20.864431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:20.869293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:20.870000 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:20.870271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:20.870789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:20.871752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:20.872353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:20.873758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:20.883099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 94/184] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:20.889088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:20.999863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5da5a0-047a-4425-9934-3fe9cf20b5fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:21.043136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:21.044087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.044376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.044654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] PATH_INFO: `/v3/users/5dbe4f308af7454c9b6fe6bc767008f4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.045975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] RBAC: Authorizing `identity:get_user(user_id=5dbe4f308af7454c9b6fe6bc767008f4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:21.047486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:21.049481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 91/185] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:20 2022] GET /identity/v3/users/5dbe4f308af7454c9b6fe6bc767008f4 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:21.054969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:21.167049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb83f5-9b7a-4942-9524-2e5c4f26177f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:21.208820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:21.209583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.209873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.210155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.277641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:21.287667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:21.289318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:21.399975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 95/186] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:21.406290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:21.472998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:21.521371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7873673-af76-4a13-8d55-6b1916ccaace None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:21.558865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e359-1fa0-46fa-bd39-ea01d8150a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:21.559751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e359-1fa0-46fa-bd39-ea01d8150a57 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.560060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e359-1fa0-46fa-bd39-ea01d8150a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.560349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e359-1fa0-46fa-bd39-ea01d8150a57 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.561629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214e359-1fa0-46fa-bd39-ea01d8150a57 None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:21.563091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214e359-1fa0-46fa-bd39-ea01d8150a57 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:21.565094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 92/187] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:21 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:21.570843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:21.669177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:21.691805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98eaf4-2557-46d6-93da-954635aa7646 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:21.729845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce1fab-5659-4c77-99c7-c754433d702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:21.730804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1fab-5659-4c77-99c7-c754433d702b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.731092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1fab-5659-4c77-99c7-c754433d702b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.731373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1fab-5659-4c77-99c7-c754433d702b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.732282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce1fab-5659-4c77-99c7-c754433d702b None admin] RBAC: Adding query filter params (role.id=c4f44a11e6224a609539553c6462d0cc, scope.project.id=e270cff1485142ceb7dfa49f549bcc09, user.id=5dbe4f308af7454c9b6fe6bc767008f4) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:21.732601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce1fab-5659-4c77-99c7-c754433d702b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:21.734107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce1fab-5659-4c77-99c7-c754433d702b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:21.741553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 96/188] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:21 2022] GET /identity/v3/role_assignments?user.id=5dbe4f308af7454c9b6fe6bc767008f4&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=c4f44a11e6224a609539553c6462d0cc => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:21.811859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b515e-611f-4fc4-ae5f-e68e974c2133 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.812219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b515e-611f-4fc4-ae5f-e68e974c2133 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.812464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b515e-611f-4fc4-ae5f-e68e974c2133 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.813946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 93/189] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:21.820039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6b3d-d488-4368-8a6f-8bfe40c1b51f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.820353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6b3d-d488-4368-8a6f-8bfe40c1b51f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.820603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6b3d-d488-4368-8a6f-8bfe40c1b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.841184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-59cf6b3d-d488-4368-8a6f-8bfe40c1b51f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:21.843254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59cf6b3d-d488-4368-8a6f-8bfe40c1b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:21.924830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 97/190] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:21.950836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b515e-611f-4fc4-ae5f-e68e974c2133 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:21.958908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97908565-3839-4155-a764-98a826e93b82 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.959205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97908565-3839-4155-a764-98a826e93b82 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.959488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97908565-3839-4155-a764-98a826e93b82 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.961198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 98/191] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:21.967517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b609-b5e2-4148-95b6-272527358066 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:21.968157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b609-b5e2-4148-95b6-272527358066 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:21.968608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b609-b5e2-4148-95b6-272527358066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:21.987425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f205b609-b5e2-4148-95b6-272527358066 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:21.988600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f205b609-b5e2-4148-95b6-272527358066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:22.077332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 99/192] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:22.097262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b515e-611f-4fc4-ae5f-e68e974c2133 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.101547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b609-b5e2-4148-95b6-272527358066 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.112100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.130861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.141734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.142854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.143318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.143796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.159183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:22.167109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:22.168006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:22.168828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 94/193] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:22.174092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.218155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b609-b5e2-4148-95b6-272527358066 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.260058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69e2a8-bf33-4298-b08c-a45cd6b0dc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.261822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e2a8-bf33-4298-b08c-a45cd6b0dc33 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.262087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e2a8-bf33-4298-b08c-a45cd6b0dc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.262415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e2a8-bf33-4298-b08c-a45cd6b0dc33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.275066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69e2a8-bf33-4298-b08c-a45cd6b0dc33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4b69e2a8-bf33-4298-b08c-a45cd6b0dc33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:22.283227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:22.284152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:22.284982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 100/194] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:22.285814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d3a02-17e4-4f13-b7d6-cbccef59a789 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.286006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d3a02-17e4-4f13-b7d6-cbccef59a789 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.286285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d3a02-17e4-4f13-b7d6-cbccef59a789 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.287579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 101/195] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:22.293946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d3a02-17e4-4f13-b7d6-cbccef59a789 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.296819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5f351-8c12-4935-a25d-ea85a3f7848a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.334764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff645e8-5494-44a4-9edc-e16aded98152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.335441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff645e8-5494-44a4-9edc-e16aded98152 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.335730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff645e8-5494-44a4-9edc-e16aded98152 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.336042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff645e8-5494-44a4-9edc-e16aded98152 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.336813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff645e8-5494-44a4-9edc-e16aded98152 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:22.337129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff645e8-5494-44a4-9edc-e16aded98152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:22.338559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff645e8-5494-44a4-9edc-e16aded98152 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:22.347048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 95/196] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:22.348510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3dd4-3921-4c98-9372-e716af57b510 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.348939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3dd4-3921-4c98-9372-e716af57b510 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.349084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3dd4-3921-4c98-9372-e716af57b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.366851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-59ee3dd4-3921-4c98-9372-e716af57b510 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:22.368049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-59ee3dd4-3921-4c98-9372-e716af57b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:22.373879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.411279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d3a02-17e4-4f13-b7d6-cbccef59a789 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.418118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.442924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 96/197] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:22.444066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee3dd4-3921-4c98-9372-e716af57b510 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.453569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.454304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.454593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.454929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.455793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:22.456141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:22.457562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:22.468683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 102/198] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:22.468940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.572506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee3dd4-3921-4c98-9372-e716af57b510 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.583896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e998e28-366a-49e8-81d5-a0b4866afca2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.609213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.610096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.610373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.610651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] PATH_INFO: `/v3/users/45e8a6b1122e48be8386fc8a3662b273` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.613926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.621950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.622758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.623052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.623336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.624581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:22.625620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a6b1122e48be8386fc8a3662b273)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:22.626036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:22.627139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:22.627688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 103/199] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:22.628496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.628914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 97/200] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/users/45e8a6b1122e48be8386fc8a3662b273 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:22.633471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.697514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.772538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bf393-52b8-43b5-a0fb-b5079c8e2a08 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.786895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ac0e0-18f6-4e3a-b6f1-378bf0aea266 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.808411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.817528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.817528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.817528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] PATH_INFO: `/v3/users/45e8a6b1122e48be8386fc8a3662b273` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.817528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a6b1122e48be8386fc8a3662b273)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:22.817528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:22.818629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 104/201] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/users/45e8a6b1122e48be8386fc8a3662b273 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:22.819264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.826168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.826817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.827102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.827379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.828141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:22.829601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:22.860726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 98/202] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:46:22 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:46:22.861570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:22.888959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.928690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49dc35-2c67-4cda-b1eb-3f683e183097 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:22.971147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:22.971826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:22.972147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:22.972441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:22.982317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:22.991291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23587a7-015f-474d-ad28-fec4909c1024 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:23.039865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:23.040609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:23.040901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:23.041181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:23.073920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:23.075322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:23.127450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:23.129157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:23.164365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:23.212127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 105/203] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:23.217889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:23.251637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:23.262528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 99/204] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:23.268796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:23.335818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa36ce-094f-4871-8c12-1a4231805d91 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:23.370465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:23.371415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:23.371718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:23.372557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:23.373776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:23.375231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:23.377126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 106/205] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:23 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:23.383279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:23.393665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b8362-5cc8-4071-96d8-b31eeacfe060 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:23.419840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:23.454080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:23.455501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:23.455974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:23.456979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:23.458721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:23.460857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:23.462782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 100/206] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:23 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:23.469064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:23.497613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dd7d4-3d62-4422-8405-26ddb7c37f2b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:23.538530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:23.539543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af0018-8abe-4b77-ac78-2dd7bebadc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:23.540351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0018-8abe-4b77-ac78-2dd7bebadc3c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:23.540633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0018-8abe-4b77-ac78-2dd7bebadc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:23.540943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0018-8abe-4b77-ac78-2dd7bebadc3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:23.542764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af0018-8abe-4b77-ac78-2dd7bebadc3c None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=45e8a6b1122e48be8386fc8a3662b273) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:23.543089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af0018-8abe-4b77-ac78-2dd7bebadc3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:23.544606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af0018-8abe-4b77-ac78-2dd7bebadc3c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:23.550463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 107/207] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:23 2022] GET /identity/v3/role_assignments?user.id=45e8a6b1122e48be8386fc8a3662b273&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:23.592654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f255-8e48-4556-9282-abaa5b04a282 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:23.634580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009acf2-0570-48b3-9909-f01494cef9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:23.635834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009acf2-0570-48b3-9909-f01494cef9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:23.636144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009acf2-0570-48b3-9909-f01494cef9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:23.636428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009acf2-0570-48b3-9909-f01494cef9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:23.637302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009acf2-0570-48b3-9909-f01494cef9c0 None admin] RBAC: Adding query filter params (role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=45e8a6b1122e48be8386fc8a3662b273) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:23.637620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009acf2-0570-48b3-9909-f01494cef9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:23.639133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009acf2-0570-48b3-9909-f01494cef9c0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:23.646069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 101/208] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:23 2022] GET /identity/v3/role_assignments?user.id=45e8a6b1122e48be8386fc8a3662b273&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:25.333523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3a3f6-c84b-4b14-8a7f-4417e0009fdb None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.334038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3a3f6-c84b-4b14-8a7f-4417e0009fdb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.334147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3a3f6-c84b-4b14-8a7f-4417e0009fdb None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.335599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 108/209] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:25.340872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3f95-8127-405c-a516-3d779943c7a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.341309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3f95-8127-405c-a516-3d779943c7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.341487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3f95-8127-405c-a516-3d779943c7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.360233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-24de3f95-8127-405c-a516-3d779943c7a4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:25.361460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-24de3f95-8127-405c-a516-3d779943c7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:25.407835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52af6c-5e9d-4a82-a519-c8780143ca35 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.408162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52af6c-5e9d-4a82-a519-c8780143ca35 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.408422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52af6c-5e9d-4a82-a519-c8780143ca35 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.409939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 109/210] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:25.415037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf8344-5f73-48a4-8438-bbfacc6a3b8b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.415325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf8344-5f73-48a4-8438-bbfacc6a3b8b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.415605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf8344-5f73-48a4-8438-bbfacc6a3b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.437103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3baf8344-5f73-48a4-8438-bbfacc6a3b8b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:25.437290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 102/211] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:25.438346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3baf8344-5f73-48a4-8438-bbfacc6a3b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:25.463609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3f95-8127-405c-a516-3d779943c7a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:25.518529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 110/212] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:25.527942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:25.546626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf8344-5f73-48a4-8438-bbfacc6a3b8b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:25.577865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:25.582480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3f95-8127-405c-a516-3d779943c7a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:25.627491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:25.628267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.628633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.628917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.648846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:25.659139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:25.660190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:25.661001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:25.661623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 103/213] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:25.668322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:25.677428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf8344-5f73-48a4-8438-bbfacc6a3b8b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:25.726458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:25.727416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.727703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.727988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.730603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:25.732566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:25.734555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 111/214] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:25.740356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:25.805801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87faba-44b9-42d5-892a-7bf1c9b82048 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:25.825119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:25.846411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaff37-3589-49b4-a1f2-f1d531e7e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:25.847350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaff37-3589-49b4-a1f2-f1d531e7e358 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.847804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaff37-3589-49b4-a1f2-f1d531e7e358 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.848126 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaff37-3589-49b4-a1f2-f1d531e7e358 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.848894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaff37-3589-49b4-a1f2-f1d531e7e358 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:25.849212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaff37-3589-49b4-a1f2-f1d531e7e358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:25.850601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaff37-3589-49b4-a1f2-f1d531e7e358 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:25.860254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 104/215] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:25.861958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:25.866286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8049ec-fcbe-4f7d-a6b9-c6ea1d9c90af None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.866577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8049ec-fcbe-4f7d-a6b9-c6ea1d9c90af None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.866858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8049ec-fcbe-4f7d-a6b9-c6ea1d9c90af None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.868213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 105/216] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:25.868919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8049ec-fcbe-4f7d-a6b9-c6ea1d9c90af None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:25.870182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a7f3-9f47-4a20-acff-b0b1df5dfb1b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:25.908410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65005f-c05a-4dd5-a1d0-e2cc702ccebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:25.909008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65005f-c05a-4dd5-a1d0-e2cc702ccebf None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.909290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65005f-c05a-4dd5-a1d0-e2cc702ccebf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.909567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65005f-c05a-4dd5-a1d0-e2cc702ccebf None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.910284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65005f-c05a-4dd5-a1d0-e2cc702ccebf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:25.911723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65005f-c05a-4dd5-a1d0-e2cc702ccebf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:25.938689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 112/217] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:46:25 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:25.940147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f3ce-c289-4bb7-bb4a-f330e21488b5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:25.940450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f3ce-c289-4bb7-bb4a-f330e21488b5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:25.940747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f3ce-c289-4bb7-bb4a-f330e21488b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:25.966554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dd57f3ce-c289-4bb7-bb4a-f330e21488b5 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:25.967774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dd57f3ce-c289-4bb7-bb4a-f330e21488b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:25.983080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8049ec-fcbe-4f7d-a6b9-c6ea1d9c90af None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.021576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78725a5d-261e-43cf-98f3-8c630be66d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.022942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78725a5d-261e-43cf-98f3-8c630be66d96 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.023690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78725a5d-261e-43cf-98f3-8c630be66d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.024210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78725a5d-261e-43cf-98f3-8c630be66d96 None admin] PATH_INFO: `/v3/users/ae4763e5a2c54215bc325da56fcdb381` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.039852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78725a5d-261e-43cf-98f3-8c630be66d96 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4763e5a2c54215bc325da56fcdb381)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:26.041762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78725a5d-261e-43cf-98f3-8c630be66d96 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:26.043900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 106/218] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:25 2022] GET /identity/v3/users/ae4763e5a2c54215bc325da56fcdb381 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:26.044689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 113/219] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:26.045666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734d4c-dc2d-4170-b62d-d0fd78edd49a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.045960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734d4c-dc2d-4170-b62d-d0fd78edd49a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.046239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734d4c-dc2d-4170-b62d-d0fd78edd49a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.047661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 107/220] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:26.056076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57f3ce-c289-4bb7-bb4a-f330e21488b5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.056275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fe95c-e244-4fe1-a115-3e80dac6c320 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.056275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fe95c-e244-4fe1-a115-3e80dac6c320 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.056275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fe95c-e244-4fe1-a115-3e80dac6c320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.074802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-569fe95c-e244-4fe1-a115-3e80dac6c320 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:26.076091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-569fe95c-e244-4fe1-a115-3e80dac6c320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:26.108760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.151759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.160590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 108/221] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:26.161224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fe95c-e244-4fe1-a115-3e80dac6c320 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.180266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57f3ce-c289-4bb7-bb4a-f330e21488b5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.220493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.221152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.221442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.221837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.284733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fe95c-e244-4fe1-a115-3e80dac6c320 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.310216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:26.311274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:26.331002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.331965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.332281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.332563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.346970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:26.356049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:26.356979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 109/222] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:26.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.397726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.402516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.425472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 114/223] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:26.426867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.506209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288e78b-0125-4d68-a1ab-398d9edfbba8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.552670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.553672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.553972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.554256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.562701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de455-c6ff-4199-aa6e-a1625290bfc0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.568847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:26.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:26.580662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:26.581444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 110/224] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:26.582104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.610136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.611668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.612210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.612942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.614395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:26.615159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:26.617068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:26.627307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 115/225] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:26.628177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.676936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.691343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.709141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c76d2e-5e7f-4d11-8fec-3f0fc6361030 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.737756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a76a6-8367-4929-92cb-b768171d3c44 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.749137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.750352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.750878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.751352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.753542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:26.755333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:26.764840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 111/226] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:26.766040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.783044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.783730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.784089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.784376 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.785205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:26.785574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:26.787013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:26.796624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 116/227] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:26.797464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.887787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9def38-797a-4c83-8cef-263bf90931c7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.924453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fbb1d-ecfd-4c1d-8883-accba143bfd0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:26.925477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.926371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.926661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.926997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] PATH_INFO: `/v3/users/45e8a6b1122e48be8386fc8a3662b273` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.928404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a6b1122e48be8386fc8a3662b273)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:26.930756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:26.933231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 112/228] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/users/45e8a6b1122e48be8386fc8a3662b273 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:26.934023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:26.935324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.967583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:26.975419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:26.977058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:26.977695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:26.978305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:26.979393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=ae4763e5a2c54215bc325da56fcdb381) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:26.980269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:26.981768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:27.000054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 117/229] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/role_assignments?user.id=ae4763e5a2c54215bc325da56fcdb381&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=2e54f04264af40db9d9999111f07233f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:27.000054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:27.111370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278810e2-41d4-4896-bce6-4e0655704008 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:27.179136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:27.179952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:27.180266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:27.180549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] PATH_INFO: `/v3/users/45e8a6b1122e48be8386fc8a3662b273` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:27.185158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a6b1122e48be8386fc8a3662b273)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:27.186878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:27.188938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 113/230] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/users/45e8a6b1122e48be8386fc8a3662b273 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:27.194411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:27.240986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e92f6-4802-4e3d-8b5f-6705555ee1c5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:27.300052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:27.301020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:27.301313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:27.301584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:27.302988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:27.304500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:27.306594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 118/231] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:26 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:27.313044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:27.382194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:27.384469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:27.413543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd2ae-c1c9-4c0b-949d-ad9ea4664bfa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:27.454525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6c626-c43b-40a5-81b1-98ee5f94e645 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:27.486094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:27.487215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:27.487669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:27.488142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:27.491358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d206eae-3f61-4b1c-af28-52b76901a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:27.492254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:27.492531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206eae-3f61-4b1c-af28-52b76901a769 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:27.492916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206eae-3f61-4b1c-af28-52b76901a769 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:27.493294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206eae-3f61-4b1c-af28-52b76901a769 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/45e8a6b1122e48be8386fc8a3662b273/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:27.494920 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:27.496852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 114/232] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:27 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:27.501864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d206eae-3f61-4b1c-af28-52b76901a769 None admin] RBAC: Authorizing `identity:create_grant(project_id=1664139aa3df4640a7ea00dfab7c3bb1, user_id=45e8a6b1122e48be8386fc8a3662b273, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:27.501864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d206eae-3f61-4b1c-af28-52b76901a769 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:27.503024 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:27.515742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 119/233] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:27 2022] PUT /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/45e8a6b1122e48be8386fc8a3662b273/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:27.674513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f32d8-e1d7-465a-8ada-94f37dcf4679 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:27.724512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2f0b3-ac0e-47bb-af3a-8d2899c1cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:27.725329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2f0b3-ac0e-47bb-af3a-8d2899c1cb99 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:27.725666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2f0b3-ac0e-47bb-af3a-8d2899c1cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:27.725946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2f0b3-ac0e-47bb-af3a-8d2899c1cb99 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/45e8a6b1122e48be8386fc8a3662b273/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:27.728320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2f0b3-ac0e-47bb-af3a-8d2899c1cb99 None admin] RBAC: Authorizing `identity:create_grant(project_id=1664139aa3df4640a7ea00dfab7c3bb1, user_id=45e8a6b1122e48be8386fc8a3662b273, role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:27.730460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2f0b3-ac0e-47bb-af3a-8d2899c1cb99 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:27.759137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 115/234] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:27 2022] PUT /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/45e8a6b1122e48be8386fc8a3662b273/roles/cdcd22caf11c40b490d53fab54878c23 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:28.464068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfddd7-0e38-43c4-9a25-bc4ad685a427 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:28.464963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfddd7-0e38-43c4-9a25-bc4ad685a427 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:28.465514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfddd7-0e38-43c4-9a25-bc4ad685a427 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:28.467377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 120/235] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:28.473070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee7a5-57ce-4ee6-8f93-55dd4b15fde0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:28.473563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee7a5-57ce-4ee6-8f93-55dd4b15fde0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:28.473634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee7a5-57ce-4ee6-8f93-55dd4b15fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:28.497125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7dcee7a5-57ce-4ee6-8f93-55dd4b15fde0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:28.498351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7dcee7a5-57ce-4ee6-8f93-55dd4b15fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:28.522272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:28.594824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 116/236] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:28.643373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfddd7-0e38-43c4-9a25-bc4ad685a427 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:28.785145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:28.793004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfddd7-0e38-43c4-9a25-bc4ad685a427 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:28.842800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692334c4-0095-44ad-bba6-aa8935de08fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:28.843999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692334c4-0095-44ad-bba6-aa8935de08fc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:28.844521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692334c4-0095-44ad-bba6-aa8935de08fc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:28.845021 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692334c4-0095-44ad-bba6-aa8935de08fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:28.846391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692334c4-0095-44ad-bba6-aa8935de08fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:28.848044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692334c4-0095-44ad-bba6-aa8935de08fc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:28.849894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 121/237] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:28.855846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee7a5-57ce-4ee6-8f93-55dd4b15fde0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:28.971114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ece02-975f-437e-8036-61bf43df492c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:28.971488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ece02-975f-437e-8036-61bf43df492c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:28.972150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ece02-975f-437e-8036-61bf43df492c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:28.975027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 122/238] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:46:28.986696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abd137-712e-417a-9d61-dcc1fc24ec76 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:28.987670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abd137-712e-417a-9d61-dcc1fc24ec76 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:28.988482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abd137-712e-417a-9d61-dcc1fc24ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:29.017722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-83abd137-712e-417a-9d61-dcc1fc24ec76 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:29.018846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-83abd137-712e-417a-9d61-dcc1fc24ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:29.022581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee7a5-57ce-4ee6-8f93-55dd4b15fde0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:29.082487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:29.083184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:29.083530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:29.083813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:29.084632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:29.086144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:29.126336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 117/239] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:46:28 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:29.148855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 123/240] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:29.194842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:29.199268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:29.335446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ee3a6-d169-463a-bb78-706ea6620160 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:29.375875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:29.376710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:29.377003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:29.377280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:29.389439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:29.397306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:29.398428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:29.399215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 118/241] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:29.405446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abd137-712e-417a-9d61-dcc1fc24ec76 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:29.507256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:29.515998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abd137-712e-417a-9d61-dcc1fc24ec76 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:29.565622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad843af2-3111-4b7b-bc6b-fa171b074cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:29.566327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad843af2-3111-4b7b-bc6b-fa171b074cfc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:29.566621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad843af2-3111-4b7b-bc6b-fa171b074cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:29.566902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad843af2-3111-4b7b-bc6b-fa171b074cfc None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:29.567696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad843af2-3111-4b7b-bc6b-fa171b074cfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:29.568047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad843af2-3111-4b7b-bc6b-fa171b074cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:29.569517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad843af2-3111-4b7b-bc6b-fa171b074cfc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:29.583349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 124/242] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:29.590374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:29.664797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:29.710299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50095c-c192-428a-9081-79e2b0e9ab27 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:29.755022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:29.755928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:29.756242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:29.756527 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] PATH_INFO: `/v3/users/fa71d6329dfd445dac4f00b56e52ddd6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:29.784434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] RBAC: Authorizing `identity:get_user(user_id=fa71d6329dfd445dac4f00b56e52ddd6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:29.786026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:29.788373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 119/243] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:29 2022] GET /identity/v3/users/fa71d6329dfd445dac4f00b56e52ddd6 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:29.792067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d0e2-edee-4f4d-9096-4fb82432e0df None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:29.792368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d0e2-edee-4f4d-9096-4fb82432e0df None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:29.792657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d0e2-edee-4f4d-9096-4fb82432e0df None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:29.794058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 125/244] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:29.795853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:29.799646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1675d5-c4b3-4346-80ef-c5b7d39c2d40 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:29.800242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1675d5-c4b3-4346-80ef-c5b7d39c2d40 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:29.800723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1675d5-c4b3-4346-80ef-c5b7d39c2d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:29.824299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ed1675d5-c4b3-4346-80ef-c5b7d39c2d40 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:29.825920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ed1675d5-c4b3-4346-80ef-c5b7d39c2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:29.914523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 126/245] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:29.927778 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be51d7-c476-4d73-a6af-de715894e592 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:29.938903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1675d5-c4b3-4346-80ef-c5b7d39c2d40 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:29.964483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:29.979791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:29.979791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:29.979791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:29.979791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.066275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:30.090034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1675d5-c4b3-4346-80ef-c5b7d39c2d40 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:30.120899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:30.122386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:30.145002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:30.145827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.146122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.146407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.169286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:30.177922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:30.178768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:30.179620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:30.186541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 127/246] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:30.201060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:30.318499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 120/247] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:30.325256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:30.384441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:30.444281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8e18-5061-43a2-a8aa-00ec619baaa6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:30.522529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ce7bc-140a-4778-bb61-c62b93e281d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:30.523596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ce7bc-140a-4778-bb61-c62b93e281d9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.523881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ce7bc-140a-4778-bb61-c62b93e281d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.524182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ce7bc-140a-4778-bb61-c62b93e281d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.525103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ce7bc-140a-4778-bb61-c62b93e281d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:30.525952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ce7bc-140a-4778-bb61-c62b93e281d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:30.527362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ce7bc-140a-4778-bb61-c62b93e281d9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:30.546841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 128/248] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:30.548613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fddff3-7eec-423e-9d01-1fbb051b1731 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.550125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fddff3-7eec-423e-9d01-1fbb051b1731 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.552365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fddff3-7eec-423e-9d01-1fbb051b1731 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.553947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 129/249] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:30.555884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fddff3-7eec-423e-9d01-1fbb051b1731 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:30.581550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fdea3-8a11-408f-a81c-58400fddfb26 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:30.590434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:30.628600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ac9f5-7c1b-4f10-92de-f3d9627a6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:30.630325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac9f5-7c1b-4f10-92de-f3d9627a6d9a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.630764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac9f5-7c1b-4f10-92de-f3d9627a6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.631226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac9f5-7c1b-4f10-92de-f3d9627a6d9a None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.632803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ac9f5-7c1b-4f10-92de-f3d9627a6d9a None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:30.635346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ac9f5-7c1b-4f10-92de-f3d9627a6d9a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:30.637957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 121/250] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:30 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:30.639574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe577-9e38-45a9-82bd-a350b070a7fa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.640163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe577-9e38-45a9-82bd-a350b070a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.640678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe577-9e38-45a9-82bd-a350b070a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.660995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-098fe577-9e38-45a9-82bd-a350b070a7fa None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:30.663081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-098fe577-9e38-45a9-82bd-a350b070a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:30.754837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fddff3-7eec-423e-9d01-1fbb051b1731 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:30.762221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 122/251] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:30.763467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe577-9e38-45a9-82bd-a350b070a7fa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:30.794747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:30.812510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76593-9b1c-4d90-b505-3aefea3ac986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:30.814077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76593-9b1c-4d90-b505-3aefea3ac986 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.815501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76593-9b1c-4d90-b505-3aefea3ac986 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.816030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76593-9b1c-4d90-b505-3aefea3ac986 None admin] PATH_INFO: `/v3/users/ae4763e5a2c54215bc325da56fcdb381` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.817487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76593-9b1c-4d90-b505-3aefea3ac986 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4763e5a2c54215bc325da56fcdb381)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:30.819130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76593-9b1c-4d90-b505-3aefea3ac986 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:30.821650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 130/252] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:30 2022] GET /identity/v3/users/ae4763e5a2c54215bc325da56fcdb381 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:30.824627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5416e3-a797-41a2-99c8-e7cd8646e547 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.825399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5416e3-a797-41a2-99c8-e7cd8646e547 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.825939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5416e3-a797-41a2-99c8-e7cd8646e547 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.827557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 131/253] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:30.829303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5416e3-a797-41a2-99c8-e7cd8646e547 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:30.906809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe577-9e38-45a9-82bd-a350b070a7fa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:30.944517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:30.961717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:30.963363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:30.963756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:30.964182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:30.965412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] RBAC: Adding query filter params (role.id=c4f44a11e6224a609539553c6462d0cc, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=fa71d6329dfd445dac4f00b56e52ddd6) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:30.966276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:30.968451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:30.973100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5416e3-a797-41a2-99c8-e7cd8646e547 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:30.977449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 123/254] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:30 2022] GET /identity/v3/role_assignments?user.id=fa71d6329dfd445dac4f00b56e52ddd6&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=c4f44a11e6224a609539553c6462d0cc => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:30.978485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:31.022279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737bd76-4881-419e-bb75-35e2afa3d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:31.023582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737bd76-4881-419e-bb75-35e2afa3d874 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:31.024044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737bd76-4881-419e-bb75-35e2afa3d874 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:31.024492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737bd76-4881-419e-bb75-35e2afa3d874 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:31.037668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737bd76-4881-419e-bb75-35e2afa3d874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2737bd76-4881-419e-bb75-35e2afa3d874 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:31.046409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:31.047352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:31.048147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:31.050963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 132/255] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:31.052578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9efa7-b1bc-4fd6-9b8b-f59c10fb4af1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:31.053095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9efa7-b1bc-4fd6-9b8b-f59c10fb4af1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:31.053570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9efa7-b1bc-4fd6-9b8b-f59c10fb4af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:31.080200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-19c9efa7-b1bc-4fd6-9b8b-f59c10fb4af1 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:31.082104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-19c9efa7-b1bc-4fd6-9b8b-f59c10fb4af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:31.103095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:31.130991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a546db-9910-4e4c-9ea7-26a9ac5d0c98 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:31.186666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:31.187578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:31.187866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:31.188209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:31.190380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:31.191915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:31.193890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 124/256] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:30 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:31.195508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:31.237808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 133/257] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:31.238532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9efa7-b1bc-4fd6-9b8b-f59c10fb4af1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:31.333719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:31.345947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7078f0-c2bc-48f5-bfcc-d47fbdd55b6c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:31.370923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9efa7-b1bc-4fd6-9b8b-f59c10fb4af1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:31.400846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:31.402043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:31.402535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:31.403031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:31.404003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:31.404546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:31.406188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:31.422600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:31.423504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:31.423783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:31.424075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/ae4763e5a2c54215bc325da56fcdb381/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:31.429506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 125/258] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:31.430197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:31.431342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] RBAC: Authorizing `identity:create_grant(project_id=1664139aa3df4640a7ea00dfab7c3bb1, user_id=ae4763e5a2c54215bc325da56fcdb381, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:31.434151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:31.461448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 134/259] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:31 2022] PUT /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/ae4763e5a2c54215bc325da56fcdb381/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:31.462325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:31.471351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:31.671224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21397-81fa-4d90-aa80-bbdb600153b8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:31.751541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:31.756048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:31.756048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:31.756048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:31.791862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:31.808479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:31.810288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:31.812006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 126/260] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:31.813354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0c578-e140-46b4-81b2-b3bb1f643344 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:31.823859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:31.864411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:31.881556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:31.882465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:31.882751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:31.883028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] PATH_INFO: `/v3/users/45e8a6b1122e48be8386fc8a3662b273` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:31.884502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a6b1122e48be8386fc8a3662b273)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:31.887326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:31.890528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 135/261] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:31 2022] GET /identity/v3/users/45e8a6b1122e48be8386fc8a3662b273 => generated 283 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:31.896117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:31.965657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:31.993829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab7b3-cb0b-47b7-9b1b-c4970c963af4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:32.032283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:32.033342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.033827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.034302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.035269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:32.035776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:32.037574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:32.047412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749a83-e0aa-4660-9057-17bb33c88649 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:32.052145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 127/262] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:32.053928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:32.113709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:32.114442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.114757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.115052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.168095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b334a0-9c1f-4973-804c-806961f25f42 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:32.224990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:32.227201 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.227694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.228480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] PATH_INFO: `/v3/users/45e8a6b1122e48be8386fc8a3662b273` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.233684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:32.235493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] RBAC: Authorizing `identity:get_user(user_id=45e8a6b1122e48be8386fc8a3662b273)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:32.237287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:32.245411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 128/263] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:32 2022] GET /identity/v3/users/45e8a6b1122e48be8386fc8a3662b273 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:32.248228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:32.252931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:32.254434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:32.256479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:32.436130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dcb3a-ac3c-4d55-ac08-38d9b18040be None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:32.460631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 136/264] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:46:32.466347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:32.544932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:32.545531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.545820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.546102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.618604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:32.628346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812a0dd-d345-4335-a599-eda705d7a1a3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:32.693803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:32.694697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.694992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.695273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.700854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:32.702343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:32.704510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 137/265] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:32 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:32.710200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:32.742082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:32.743668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:32.765777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:32.852808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54c47-d166-49a6-886e-0458c29b399a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:32.898630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3566c7-f486-41d1-9d03-6f88345e93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:32.899310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3566c7-f486-41d1-9d03-6f88345e93a5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.899648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3566c7-f486-41d1-9d03-6f88345e93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.899934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3566c7-f486-41d1-9d03-6f88345e93a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.901684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3566c7-f486-41d1-9d03-6f88345e93a5 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=45e8a6b1122e48be8386fc8a3662b273) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:32.902350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3566c7-f486-41d1-9d03-6f88345e93a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:32.904429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3566c7-f486-41d1-9d03-6f88345e93a5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:32.912837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 138/266] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:32 2022] GET /identity/v3/role_assignments?user.id=45e8a6b1122e48be8386fc8a3662b273&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:32.914176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4235-c91f-4c04-88de-0c69efa51bca None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.914472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4235-c91f-4c04-88de-0c69efa51bca None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.914755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4235-c91f-4c04-88de-0c69efa51bca None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.922143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 139/267] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:32.928245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbebe5b-4a32-4e9d-8099-01b50bc60166 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:32.928580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbebe5b-4a32-4e9d-8099-01b50bc60166 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:32.928811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbebe5b-4a32-4e9d-8099-01b50bc60166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:32.965047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fcbebe5b-4a32-4e9d-8099-01b50bc60166 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:32.966299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fcbebe5b-4a32-4e9d-8099-01b50bc60166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:33.011045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:33.078981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 129/268] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:33.085006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:33.110810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 140/269] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:33.111944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d9a0-9448-4b1b-8b52-2ac150ad6e60 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.112263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d9a0-9448-4b1b-8b52-2ac150ad6e60 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.112541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d9a0-9448-4b1b-8b52-2ac150ad6e60 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.114102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 141/270] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:33.121455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8616e-e027-42a9-8d28-c3003079e63c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.121748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8616e-e027-42a9-8d28-c3003079e63c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.122024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8616e-e027-42a9-8d28-c3003079e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.169612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b4a8616e-e027-42a9-8d28-c3003079e63c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:33.171204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b4a8616e-e027-42a9-8d28-c3003079e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:33.245512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c8fbe-6298-470a-90c1-0c574ca72b0a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:33.256421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:33.293749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:33.294625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.294911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.295190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.296452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:33.297965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:33.299990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 130/272] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:33 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:33.300125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 142/272] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:33.300868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:33.309210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8616e-e027-42a9-8d28-c3003079e63c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:33.437361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b33f-dc08-4bd7-9f8e-73e51008d191 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:33.443789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:33.461118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8616e-e027-42a9-8d28-c3003079e63c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:33.491197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:33.492027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.492323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.492604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.510479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:33.511974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:33.512685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.512969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.513298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.514142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] RBAC: Adding query filter params (role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=45e8a6b1122e48be8386fc8a3662b273) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:33.514503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:33.515980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:33.521338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:33.522245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:33.523299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:33.523894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 131/273] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:33.524651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 143/274] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:33 2022] GET /identity/v3/role_assignments?user.id=45e8a6b1122e48be8386fc8a3662b273&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:33.528770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:33.530233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:33.617690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:33.728894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adb05-e228-43e5-89f3-f1c65e6ae8d2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:33.743716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407f016-dd57-4e54-87bb-571c6cee47fb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:33.812780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e78690-388e-4814-94b9-834c481db807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:33.813743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e78690-388e-4814-94b9-834c481db807 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.813849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e78690-388e-4814-94b9-834c481db807 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.814145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e78690-388e-4814-94b9-834c481db807 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.816847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e78690-388e-4814-94b9-834c481db807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:33.817965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e78690-388e-4814-94b9-834c481db807 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:33.820245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 132/275] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:33.824378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e6db4-2474-4f29-b911-8f390114dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:33.825440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6db4-2474-4f29-b911-8f390114dabb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.825924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6db4-2474-4f29-b911-8f390114dabb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.826392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e6db4-2474-4f29-b911-8f390114dabb None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.827060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068a50-a72c-4f94-8811-3542ab5c6d0f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.827356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068a50-a72c-4f94-8811-3542ab5c6d0f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.827639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068a50-a72c-4f94-8811-3542ab5c6d0f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.827994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e6db4-2474-4f29-b911-8f390114dabb None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:33.828526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e6db4-2474-4f29-b911-8f390114dabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:33.829041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 133/276] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:33.830120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068a50-a72c-4f94-8811-3542ab5c6d0f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:33.830558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e6db4-2474-4f29-b911-8f390114dabb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:33.842119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 144/277] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:33.843891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a36598-dc10-42af-8e6d-ea584e44d139 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:33.844355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a36598-dc10-42af-8e6d-ea584e44d139 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:33.844774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a36598-dc10-42af-8e6d-ea584e44d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:33.865091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-15a36598-dc10-42af-8e6d-ea584e44d139 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:33.867081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-15a36598-dc10-42af-8e6d-ea584e44d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:33.879172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:33.982180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 145/278] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:33.982969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a36598-dc10-42af-8e6d-ea584e44d139 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:34.000061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:34.004878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068a50-a72c-4f94-8811-3542ab5c6d0f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:34.055285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:34.056934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.057404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.057880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.059134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:34.061509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:34.104066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 134/279] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:46:33 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:46:34.104066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:34.157542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a36598-dc10-42af-8e6d-ea584e44d139 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:34.206564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:34.207577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.207921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.208300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] PATH_INFO: `/v3/users/c272b1871e5f4c1cb65a7c36171ceba2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.227574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] RBAC: Authorizing `identity:get_user(user_id=c272b1871e5f4c1cb65a7c36171ceba2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:34.230554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:34.237894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 146/280] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:33 2022] GET /identity/v3/users/c272b1871e5f4c1cb65a7c36171ceba2 => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:34.239547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:34.268398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:34.271456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8c6e-590e-4f23-85b5-6d1bb1003fba None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:34.325820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:34.327057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.327601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.328140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.343624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:34.352134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:34.353079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:34.354558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 135/281] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:34.359666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:34.381752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:34.395386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca91605-8dc6-49f4-987c-27fecb0c460b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:34.452547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:34.454149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.454848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.455418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.456671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, user.id=c272b1871e5f4c1cb65a7c36171ceba2, scope.system=all) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:34.457450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:34.459773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:34.465573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 147/282] 10.222.0.69 () {56 vars in 1308 bytes} [Thu May 26 17:46:34 2022] GET /identity/v3/role_assignments?user.id=c272b1871e5f4c1cb65a7c36171ceba2&scope.system=all&role.id=2e54f04264af40db9d9999111f07233f => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:34.510973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9739b-c932-46b9-ad2c-d9e6b3e87aa5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:34.555648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f436b-099f-468c-9794-05519673d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:34.557057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f436b-099f-468c-9794-05519673d8dd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.557538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f436b-099f-468c-9794-05519673d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.557832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f436b-099f-468c-9794-05519673d8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.558671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f436b-099f-468c-9794-05519673d8dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:34.558984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f436b-099f-468c-9794-05519673d8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:34.560517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f436b-099f-468c-9794-05519673d8dd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:34.574882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 136/283] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:34.580770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:34.602044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fde456-55bd-42a2-b08d-4596899a7fed None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.602352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fde456-55bd-42a2-b08d-4596899a7fed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.602669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fde456-55bd-42a2-b08d-4596899a7fed None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.605533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 137/284] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:34.612712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58415c79-188a-402b-9112-938149fc9e80 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.613010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58415c79-188a-402b-9112-938149fc9e80 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.613276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58415c79-188a-402b-9112-938149fc9e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.635050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-58415c79-188a-402b-9112-938149fc9e80 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:34.636333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-58415c79-188a-402b-9112-938149fc9e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:34.674768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:34.724200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c685778-9d85-48b3-a92f-7f1fea38c1f1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:34.744708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 138/285] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:34.770206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58415c79-188a-402b-9112-938149fc9e80 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:34.788400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:34.819220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:34.820512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:34.821049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:34.822061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] PATH_INFO: `/v3/users/fa71d6329dfd445dac4f00b56e52ddd6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:34.826240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] RBAC: Authorizing `identity:get_user(user_id=fa71d6329dfd445dac4f00b56e52ddd6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:34.827982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:34.833062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 148/286] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:34 2022] GET /identity/v3/users/fa71d6329dfd445dac4f00b56e52ddd6 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:34.840563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:34.958877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58415c79-188a-402b-9112-938149fc9e80 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:35.013732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:35.014801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:35.015232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:35.015657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:35.030269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:35.038410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:35.039526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:35.040524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:35.043500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 139/287] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:35.049880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:35.069699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7ae7-8f53-4041-8ffe-edc8786a69ad None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:35.156815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:35.157710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:35.158002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:35.158284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:35.159609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:35.161101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:35.163154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 149/288] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:34 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:35.165446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:35.169472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:35.172404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:35.232036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2a5a5-0d33-4cd3-a2d5-f22fbea26715 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:35.301437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:35.302036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:35.302322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:35.302600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:35.303365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:35.303677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:35.305132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:35.334060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 140/289] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:35.341064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:35.348844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced11b-ff4c-47ec-b1e5-eaa22b7ba079 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:35.406975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:35.407883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:35.408192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:35.408471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/fa71d6329dfd445dac4f00b56e52ddd6/roles/c4f44a11e6224a609539553c6462d0cc` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:35.411091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1664139aa3df4640a7ea00dfab7c3bb1, user_id=fa71d6329dfd445dac4f00b56e52ddd6, role_id=c4f44a11e6224a609539553c6462d0cc)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:35.412763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:35.438784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 150/290] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:46:35 2022] PUT /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/users/fa71d6329dfd445dac4f00b56e52ddd6/roles/c4f44a11e6224a609539553c6462d0cc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:35.529182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6c0ea-3b65-49fc-bbb6-21af11bacee2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:35.579909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:35.586672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:35.587613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:35.587894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:35.588203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] PATH_INFO: `/v3/users/ae4763e5a2c54215bc325da56fcdb381` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:35.593298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4763e5a2c54215bc325da56fcdb381)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:35.595173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:35.597265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 141/291] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:35 2022] GET /identity/v3/users/ae4763e5a2c54215bc325da56fcdb381 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:35.603725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:35.672895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:35.717066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3c308-3724-4d7c-ac37-e8fe910b3da9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:35.766798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:35.767490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:35.767782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:35.768082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:35.884528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:35.886065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:35.966378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:36.005620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 151/292] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:36.011288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:36.183314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17f5e-f6a6-48de-8600-4c2336c609e2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:36.234285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ab70c-b176-4620-b222-aa1c7664882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:36.235170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab70c-b176-4620-b222-aa1c7664882b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:36.235461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab70c-b176-4620-b222-aa1c7664882b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:36.235743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab70c-b176-4620-b222-aa1c7664882b None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:36.240789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ab70c-b176-4620-b222-aa1c7664882b None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:36.242280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ab70c-b176-4620-b222-aa1c7664882b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:36.244586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 142/293] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:36 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:36.250174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:36.408895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956a3a-806e-455d-8683-27f64926a101 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:36.458292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebacbf-c0e1-4d18-aeca-c391a0488ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:36.458879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebacbf-c0e1-4d18-aeca-c391a0488ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:36.459166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebacbf-c0e1-4d18-aeca-c391a0488ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:36.459447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebacbf-c0e1-4d18-aeca-c391a0488ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:36.460336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebacbf-c0e1-4d18-aeca-c391a0488ff4 None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=ae4763e5a2c54215bc325da56fcdb381) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:36.460658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebacbf-c0e1-4d18-aeca-c391a0488ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:36.462101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebacbf-c0e1-4d18-aeca-c391a0488ff4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:36.469868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 152/294] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:36 2022] GET /identity/v3/role_assignments?user.id=ae4763e5a2c54215bc325da56fcdb381&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=2e54f04264af40db9d9999111f07233f => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:37.051595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a653c7-368e-4127-ad19-166b6ce7b32c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.052293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a653c7-368e-4127-ad19-166b6ce7b32c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.052293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a653c7-368e-4127-ad19-166b6ce7b32c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.053816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 143/295] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:37.059667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63bab-af29-457b-b129-d5f6d2027657 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.060259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63bab-af29-457b-b129-d5f6d2027657 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.060744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63bab-af29-457b-b129-d5f6d2027657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.081031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0fc63bab-af29-457b-b129-d5f6d2027657 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:37.082606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0fc63bab-af29-457b-b129-d5f6d2027657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:37.102331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b0a1-ddc9-4333-b722-9a32f9359ebf None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.102997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b0a1-ddc9-4333-b722-9a32f9359ebf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.103489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b0a1-ddc9-4333-b722-9a32f9359ebf None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.105160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 144/296] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:37.111176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02870b-0427-4279-8f10-d3f0261bb836 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.111768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02870b-0427-4279-8f10-d3f0261bb836 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.112282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02870b-0427-4279-8f10-d3f0261bb836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.117842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:37.134977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0e02870b-0427-4279-8f10-d3f0261bb836 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:37.136664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0e02870b-0427-4279-8f10-d3f0261bb836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:37.188474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 153/297] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:37.212152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63bab-af29-457b-b129-d5f6d2027657 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:37.236677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:37.252157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 145/298] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:37.268933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02870b-0427-4279-8f10-d3f0261bb836 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:37.343319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63bab-af29-457b-b129-d5f6d2027657 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:37.387777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da76626-bf28-48e4-9c1f-8ea8d611ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:37.389049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da76626-bf28-48e4-9c1f-8ea8d611ec89 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.389558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da76626-bf28-48e4-9c1f-8ea8d611ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.389828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02870b-0427-4279-8f10-d3f0261bb836 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:37.390263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da76626-bf28-48e4-9c1f-8ea8d611ec89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.402510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da76626-bf28-48e4-9c1f-8ea8d611ec89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6da76626-bf28-48e4-9c1f-8ea8d611ec89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:37.410397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:37.411287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 154/299] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:37.417567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48af780-e07a-425c-9684-357e396f1f79 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.418260 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48af780-e07a-425c-9684-357e396f1f79 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.418260 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48af780-e07a-425c-9684-357e396f1f79 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.418260 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 155/300] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:37.421780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aac35-ca97-4b19-b24c-a8de6f0033b7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.422078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aac35-ca97-4b19-b24c-a8de6f0033b7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.422359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aac35-ca97-4b19-b24c-a8de6f0033b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.437768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:37.438650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.439022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.439346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.441003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:37.442410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7f6aac35-ca97-4b19-b24c-a8de6f0033b7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:37.442685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:37.443647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7f6aac35-ca97-4b19-b24c-a8de6f0033b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:37.449824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 146/301] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:37.449824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:37.465487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:37.521165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:37.528121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 156/302] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:37.528980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aac35-ca97-4b19-b24c-a8de6f0033b7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:37.574021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6442-418b-4db5-9c2c-6c24970bd67d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:37.626001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:37.626610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.626900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.627189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.627958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:37.628305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:37.629710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:37.641277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 147/303] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:37.641955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:37.656688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aac35-ca97-4b19-b24c-a8de6f0033b7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:37.702219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:37.703025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.703318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.703597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.704345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:37.705812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:37.724531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 157/304] 10.222.0.69 () {60 vars in 1134 bytes} [Thu May 26 17:46:37 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:37.725193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:37.744571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:37.793168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35bc1-5709-49e1-9724-fc6c8913d058 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:37.830677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:37.845793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:37.846614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.846898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.847173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.864568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:37.873802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:37.874952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:37.875879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 148/305] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:37.882745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:37.903784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d3f7-7ce1-4e98-aa81-ecb12fdd63a2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:37.976038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:37.976942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:37.977225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:37.977499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] PATH_INFO: `/v3/users/c1948648d70e4980b79e35acb02f6254` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:37.994351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] RBAC: Authorizing `identity:get_user(user_id=c1948648d70e4980b79e35acb02f6254)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:37.995835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:37.997946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 158/306] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:37 2022] GET /identity/v3/users/c1948648d70e4980b79e35acb02f6254 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:38.003405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:38.066955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cc66f-a33b-4eb9-90cf-e27d616fecde None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:38.088921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:38.117879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5478e-add8-4b7d-b800-3e1f9951d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:38.119105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5478e-add8-4b7d-b800-3e1f9951d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.119444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5478e-add8-4b7d-b800-3e1f9951d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.119764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5478e-add8-4b7d-b800-3e1f9951d9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.120658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5478e-add8-4b7d-b800-3e1f9951d9d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:38.121490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5478e-add8-4b7d-b800-3e1f9951d9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:38.123080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5478e-add8-4b7d-b800-3e1f9951d9d0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:38.135809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779e657-0f98-453c-8ce6-cbc99553ede4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:38.136725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 149/307] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:38.141031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b966e-3079-4e17-9a14-99adcf9301ae None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.141324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b966e-3079-4e17-9a14-99adcf9301ae None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.141604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b966e-3079-4e17-9a14-99adcf9301ae None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.143126 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 150/308] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:38.143663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b966e-3079-4e17-9a14-99adcf9301ae None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:38.179506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c494-3201-423c-aa73-a64fd12a02eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:38.180534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c494-3201-423c-aa73-a64fd12a02eb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.181546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c494-3201-423c-aa73-a64fd12a02eb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.182191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c494-3201-423c-aa73-a64fd12a02eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.183374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087c494-3201-423c-aa73-a64fd12a02eb None admin] RBAC: Adding query filter params (role.id=c4f44a11e6224a609539553c6462d0cc, user.id=c1948648d70e4980b79e35acb02f6254, scope.system=all) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:38.183881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087c494-3201-423c-aa73-a64fd12a02eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:38.185739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087c494-3201-423c-aa73-a64fd12a02eb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:38.192156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 159/309] 10.222.0.69 () {56 vars in 1308 bytes} [Thu May 26 17:46:38 2022] GET /identity/v3/role_assignments?user.id=c1948648d70e4980b79e35acb02f6254&scope.system=all&role.id=c4f44a11e6224a609539553c6462d0cc => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:38.194305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d870-4213-4e9b-814b-ed633a9711f2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.194488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d870-4213-4e9b-814b-ed633a9711f2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.194685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d870-4213-4e9b-814b-ed633a9711f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.212206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:38.216673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7857d870-4213-4e9b-814b-ed633a9711f2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:38.217926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7857d870-4213-4e9b-814b-ed633a9711f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:38.289741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b966e-3079-4e17-9a14-99adcf9301ae None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:38.312053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 160/310] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:38.329703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857d870-4213-4e9b-814b-ed633a9711f2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:38.344673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985183b4-b970-4502-926e-45f424f10abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:38.346236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985183b4-b970-4502-926e-45f424f10abb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.347370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985183b4-b970-4502-926e-45f424f10abb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.347996 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985183b4-b970-4502-926e-45f424f10abb None admin] PATH_INFO: `/v3/users/c272b1871e5f4c1cb65a7c36171ceba2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.350165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985183b4-b970-4502-926e-45f424f10abb None admin] RBAC: Authorizing `identity:get_user(user_id=c272b1871e5f4c1cb65a7c36171ceba2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:38.352464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985183b4-b970-4502-926e-45f424f10abb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:38.355980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 151/311] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:38 2022] GET /identity/v3/users/c272b1871e5f4c1cb65a7c36171ceba2 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:38.361740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985183b4-b970-4502-926e-45f424f10abb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:38.409089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:38.469752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857d870-4213-4e9b-814b-ed633a9711f2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:38.507731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985183b4-b970-4502-926e-45f424f10abb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:38.511710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:38.512558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.512848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.513131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.528068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:38.528760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:38.538090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:38.539142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:38.540257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 161/312] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:38.545952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:38.556987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:38.558828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.559292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.559714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] PATH_INFO: `/v3/system/users/c272b1871e5f4c1cb65a7c36171ceba2/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.562260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c272b1871e5f4c1cb65a7c36171ceba2, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:38.564301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:38.577608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 152/313] 10.222.0.69 () {58 vars in 1334 bytes} [Thu May 26 17:46:38 2022] PUT /identity/v3/system/users/c272b1871e5f4c1cb65a7c36171ceba2/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:46:38.672285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8271-9bc1-4d1e-ab86-b5d786b021b6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:38.693371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:38.713558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:38.714256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.714543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.714821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.715592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:38.715903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:38.717399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:38.727547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 162/314] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:38.733903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:38.869478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633e0e0-2d55-4438-87fb-4e5589288329 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:38.909588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:38.910487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:38.910774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:38.911054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] PATH_INFO: `/v3/users/fa71d6329dfd445dac4f00b56e52ddd6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:38.912425 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] RBAC: Authorizing `identity:get_user(user_id=fa71d6329dfd445dac4f00b56e52ddd6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:38.914171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:38.917679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 153/315] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:38 2022] GET /identity/v3/users/fa71d6329dfd445dac4f00b56e52ddd6 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:38.923138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:39.037283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f047-738f-430c-b584-1a969ef315d5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:39.075470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:39.076193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:39.076483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:39.076762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:39.131423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:39.155002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:39.156621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:39.279942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 163/316] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:39.289191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:39.349805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:39.406277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256942aa-cb39-46df-843d-f8ec2f85da8c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:39.444282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727139b-c916-4d61-a419-f513da944471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:39.445185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727139b-c916-4d61-a419-f513da944471 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:39.445475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727139b-c916-4d61-a419-f513da944471 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:39.445756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727139b-c916-4d61-a419-f513da944471 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:39.447594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727139b-c916-4d61-a419-f513da944471 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:39.449138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727139b-c916-4d61-a419-f513da944471 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:39.451328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 154/317] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:39 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:39.457298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:39.546097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:39.567830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744e37-6104-4c5c-ae6b-868c5cf66fa4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:39.606154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c306-3f4d-4d4e-8faa-6474fac32ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:39.606831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c306-3f4d-4d4e-8faa-6474fac32ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:39.607117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c306-3f4d-4d4e-8faa-6474fac32ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:39.607395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c306-3f4d-4d4e-8faa-6474fac32ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:39.608313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011c306-3f4d-4d4e-8faa-6474fac32ae4 None admin] RBAC: Adding query filter params (role.id=c4f44a11e6224a609539553c6462d0cc, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1, user.id=fa71d6329dfd445dac4f00b56e52ddd6) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:39.608630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011c306-3f4d-4d4e-8faa-6474fac32ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:39.610156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011c306-3f4d-4d4e-8faa-6474fac32ae4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:39.617250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 164/318] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:46:39 2022] GET /identity/v3/role_assignments?user.id=fa71d6329dfd445dac4f00b56e52ddd6&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=c4f44a11e6224a609539553c6462d0cc => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:40.136233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dde7f3-444d-4067-b890-5ea9c30b6574 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.136634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dde7f3-444d-4067-b890-5ea9c30b6574 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.136807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dde7f3-444d-4067-b890-5ea9c30b6574 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.138276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 155/319] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:40.144253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbf5e1-273f-4b45-a2ba-d4ac2b7d9df8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.144546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbf5e1-273f-4b45-a2ba-d4ac2b7d9df8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.144814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbf5e1-273f-4b45-a2ba-d4ac2b7d9df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.163392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7dbbf5e1-273f-4b45-a2ba-d4ac2b7d9df8 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:40.164653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7dbbf5e1-273f-4b45-a2ba-d4ac2b7d9df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:40.252049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 165/320] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:40.271011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dde7f3-444d-4067-b890-5ea9c30b6574 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:40.377455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dde7f3-444d-4067-b890-5ea9c30b6574 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:40.393570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:40.413591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75ce1f-af51-4220-8125-abfd12974bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:40.414424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75ce1f-af51-4220-8125-abfd12974bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.414711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75ce1f-af51-4220-8125-abfd12974bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.414991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75ce1f-af51-4220-8125-abfd12974bd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.417150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75ce1f-af51-4220-8125-abfd12974bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:40.418665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75ce1f-af51-4220-8125-abfd12974bd1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:40.420461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 156/321] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:46:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:40.426395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbf5e1-273f-4b45-a2ba-d4ac2b7d9df8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:40.507685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:40.536076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbf5e1-273f-4b45-a2ba-d4ac2b7d9df8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:40.572128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86890ede-d790-43c9-95c6-f274105d5790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:40.572882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86890ede-d790-43c9-95c6-f274105d5790 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.573238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86890ede-d790-43c9-95c6-f274105d5790 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.573527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86890ede-d790-43c9-95c6-f274105d5790 None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.574224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86890ede-d790-43c9-95c6-f274105d5790 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:40.575715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86890ede-d790-43c9-95c6-f274105d5790 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:40.600059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 166/322] 10.222.0.69 () {60 vars in 1134 bytes} [Thu May 26 17:46:40 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:46:40.611859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860093-58a6-4d32-b481-f4cb495b231a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.612190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860093-58a6-4d32-b481-f4cb495b231a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.612475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860093-58a6-4d32-b481-f4cb495b231a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.614268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 157/323] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:40.621216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e190-4ba0-4e83-8f68-2cda7150fc8a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.621546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e190-4ba0-4e83-8f68-2cda7150fc8a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.621830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e190-4ba0-4e83-8f68-2cda7150fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.639665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9182e190-4ba0-4e83-8f68-2cda7150fc8a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:40.640928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9182e190-4ba0-4e83-8f68-2cda7150fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:40.716571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 167/324] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:40.739661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860093-58a6-4d32-b481-f4cb495b231a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:40.865504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860093-58a6-4d32-b481-f4cb495b231a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:40.904784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:40.905961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.906441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.906932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.920288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:40.928330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:40.929267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:40.930023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 158/325] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:40.930659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850998a-2925-43d0-9007-5454e15539d9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.930659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850998a-2925-43d0-9007-5454e15539d9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.930659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850998a-2925-43d0-9007-5454e15539d9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.932987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 168/326] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:40.937261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:40.938521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846f91-bfdb-44d7-96db-f9927998f1b6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:40.938818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846f91-bfdb-44d7-96db-f9927998f1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:40.939118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846f91-bfdb-44d7-96db-f9927998f1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:40.958479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0e846f91-bfdb-44d7-96db-f9927998f1b6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:40.959663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0e846f91-bfdb-44d7-96db-f9927998f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:40.995712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:41.058173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:41.075400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5d7e-8981-4281-a4a8-456f031d1929 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:41.084181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 169/327] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:41.109407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e846f91-bfdb-44d7-96db-f9927998f1b6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:41.113822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:41.114505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:41.114791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:41.115070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:41.115843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:41.116190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:41.117624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:41.127322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 159/328] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:41.132995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:41.232425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e846f91-bfdb-44d7-96db-f9927998f1b6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:41.251238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79f74-fe06-4d1e-abff-417dcc354808 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:41.271233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:41.272319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:41.273462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:41.273737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:41.274006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:41.288191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:41.297411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:41.298356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:41.299192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:41.299808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:41.299808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:41.299808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:41.299808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] PATH_INFO: `/v3/users/c1948648d70e4980b79e35acb02f6254` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:41.300150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 170/329] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:41.301176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] RBAC: Authorizing `identity:get_user(user_id=c1948648d70e4980b79e35acb02f6254)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:41.301927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:41.303531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 160/330] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:41 2022] GET /identity/v3/users/c1948648d70e4980b79e35acb02f6254 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:41.309755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:41.309943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:41.371619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:41.420344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be1a5-3ac2-4ab7-8ff5-dfc3548f0b69 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:41.421524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea817-58ee-43e3-9f36-ab748dc2ca61 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:41.465003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:41.465477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:41.465698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:41.465984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:41.466264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:41.466998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:41.467116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:41.467333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:41.467675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:41.468125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] PATH_INFO: `/v3/system/users/c1948648d70e4980b79e35acb02f6254/roles/c4f44a11e6224a609539553c6462d0cc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:41.468779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:41.470057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c1948648d70e4980b79e35acb02f6254, role_id=c4f44a11e6224a609539553c6462d0cc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:41.471680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:41.480895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 171/331] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:41.485820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 161/332] 10.222.0.69 () {58 vars in 1334 bytes} [Thu May 26 17:46:41 2022] PUT /identity/v3/system/users/c1948648d70e4980b79e35acb02f6254/roles/c4f44a11e6224a609539553c6462d0cc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:41.486098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:41.624156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0940d0-d792-41f3-94c5-96dff8bcfe97 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:41.649143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:41.671481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ea49c-abef-4276-91b2-69d3c1970537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:41.672493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea49c-abef-4276-91b2-69d3c1970537 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:41.672826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea49c-abef-4276-91b2-69d3c1970537 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:41.673102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea49c-abef-4276-91b2-69d3c1970537 None admin] PATH_INFO: `/v3/users/c272b1871e5f4c1cb65a7c36171ceba2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:41.674337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ea49c-abef-4276-91b2-69d3c1970537 None admin] RBAC: Authorizing `identity:get_user(user_id=c272b1871e5f4c1cb65a7c36171ceba2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:41.675797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ea49c-abef-4276-91b2-69d3c1970537 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:41.677889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 172/333] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:41 2022] GET /identity/v3/users/c272b1871e5f4c1cb65a7c36171ceba2 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:41.683877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:41.730883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:41.806418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2638-8fbb-4263-becf-e4bb00c17407 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:41.843183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fd369-78d9-4de9-8621-9165b933cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:41.843904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fd369-78d9-4de9-8621-9165b933cf77 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:41.844219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fd369-78d9-4de9-8621-9165b933cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:41.844494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fd369-78d9-4de9-8621-9165b933cf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:41.845334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fd369-78d9-4de9-8621-9165b933cf77 None admin] RBAC: Adding query filter params (role.id=2e54f04264af40db9d9999111f07233f, user.id=c272b1871e5f4c1cb65a7c36171ceba2, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:41.845643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fd369-78d9-4de9-8621-9165b933cf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:41.847078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fd369-78d9-4de9-8621-9165b933cf77 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:41.860625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 162/334] 10.222.0.69 () {56 vars in 1308 bytes} [Thu May 26 17:46:41 2022] GET /identity/v3/role_assignments?user.id=c272b1871e5f4c1cb65a7c36171ceba2&scope.system=all&role.id=2e54f04264af40db9d9999111f07233f => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:43.509909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd76c0-cfcf-4a07-9684-997af397cc67 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:43.510478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd76c0-cfcf-4a07-9684-997af397cc67 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:43.510478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd76c0-cfcf-4a07-9684-997af397cc67 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:43.511966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 173/335] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:43.518046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ff4a7-cc33-415e-93ce-97e1fbfdc9c0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:43.518560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ff4a7-cc33-415e-93ce-97e1fbfdc9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:43.518630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ff4a7-cc33-415e-93ce-97e1fbfdc9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:43.539291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bb8ff4a7-cc33-415e-93ce-97e1fbfdc9c0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:43.542213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb8ff4a7-cc33-415e-93ce-97e1fbfdc9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:43.631221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 163/336] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:43.674433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd76c0-cfcf-4a07-9684-997af397cc67 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:43.824194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd76c0-cfcf-4a07-9684-997af397cc67 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:43.869085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:43.869888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:43.870172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:43.870446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:43.884721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:43.892678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:43.893617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:43.894428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 174/337] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:43.901542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ff4a7-cc33-415e-93ce-97e1fbfdc9c0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:43.933634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:44.028995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ff4a7-cc33-415e-93ce-97e1fbfdc9c0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:44.073305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3c37e-3283-4f06-bfee-b9eda5d319a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:44.073993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c37e-3283-4f06-bfee-b9eda5d319a7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:44.074332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c37e-3283-4f06-bfee-b9eda5d319a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:44.074549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c37e-3283-4f06-bfee-b9eda5d319a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:44.075313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c37e-3283-4f06-bfee-b9eda5d319a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:44.075618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c37e-3283-4f06-bfee-b9eda5d319a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:44.077050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c37e-3283-4f06-bfee-b9eda5d319a7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:44.086443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 164/338] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:44.092070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:44.143549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:44.207279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8b5bf-cb37-4092-aac6-00d0a1545325 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:44.248971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:44.249657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:44.249942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:44.250220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:44.296753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d86d41-0cfd-4479-bb05-86b2ae33d200 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:44.297079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d86d41-0cfd-4479-bb05-86b2ae33d200 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:44.297309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d86d41-0cfd-4479-bb05-86b2ae33d200 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:44.298712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 165/339] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:44.306424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d8637-732f-44e2-a1e1-6acb47850e24 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:44.306748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d8637-732f-44e2-a1e1-6acb47850e24 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:44.306983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d8637-732f-44e2-a1e1-6acb47850e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:44.334203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0a3d8637-732f-44e2-a1e1-6acb47850e24 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:44.335320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a3d8637-732f-44e2-a1e1-6acb47850e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:44.365905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:44.367866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:44.432179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 166/340] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:44.443917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:44.489579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d8637-732f-44e2-a1e1-6acb47850e24 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:44.518269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:44.554154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 175/341] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:44.573110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:44.657381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d8637-732f-44e2-a1e1-6acb47850e24 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:44.703134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:44.703954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:44.704271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:44.704548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:44.718664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:44.728848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:44.729992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:44.730794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 167/342] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:44.740579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:44.854698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c1c2-997d-471b-bf3d-58ce71bc8175 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:44.896148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:44.926564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127789c2-384b-4746-9fd9-7a41f612b3a4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:44.935550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:44.936476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:44.936757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:44.937036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:44.938283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:44.939766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:44.941842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 176/343] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:44 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:44.948751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:44.969602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:44.980776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:44.981475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:44.981767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:44.982049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:44.984056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:44.984056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:44.984703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:44.996211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 168/344] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:45.003966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:45.089779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07945-18ca-46fa-b425-84f13fbdde58 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:45.142563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd54f2-34f7-4802-8e14-761db74d5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:45.144156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd54f2-34f7-4802-8e14-761db74d5520 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.144440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd54f2-34f7-4802-8e14-761db74d5520 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.144716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd54f2-34f7-4802-8e14-761db74d5520 None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.161313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd54f2-34f7-4802-8e14-761db74d5520 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:45.162784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd54f2-34f7-4802-8e14-761db74d5520 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:45.164549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 177/345] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:44 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:45.168578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce35d1-5211-4b41-aa8e-e9f24fcc2255 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.168864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce35d1-5211-4b41-aa8e-e9f24fcc2255 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.169141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce35d1-5211-4b41-aa8e-e9f24fcc2255 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.170493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 178/346] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:45.185969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce35d1-5211-4b41-aa8e-e9f24fcc2255 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:45.221193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9e91c-100b-46a1-8141-a5a70621da43 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:45.265218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65be02-8c7d-453d-9913-e2accd082b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:45.265883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65be02-8c7d-453d-9913-e2accd082b90 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.266166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65be02-8c7d-453d-9913-e2accd082b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.266442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65be02-8c7d-453d-9913-e2accd082b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.278360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:45.285581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:45.316601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce35d1-5211-4b41-aa8e-e9f24fcc2255 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:45.347231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65be02-8c7d-453d-9913-e2accd082b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:45.348744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65be02-8c7d-453d-9913-e2accd082b90 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:45.367943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0a2e-4c11-451e-bcec-020f967187ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:45.369188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0a2e-4c11-451e-bcec-020f967187ef None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.369478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0a2e-4c11-451e-bcec-020f967187ef None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.369756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0a2e-4c11-451e-bcec-020f967187ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.370617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0a2e-4c11-451e-bcec-020f967187ef None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=e270cff1485142ceb7dfa49f549bcc09) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:45.370934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0a2e-4c11-451e-bcec-020f967187ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:45.372764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0a2e-4c11-451e-bcec-020f967187ef None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:45.379290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 179/347] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:45 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=2e54f04264af40db9d9999111f07233f => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:45.380394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841faaaa-3326-4183-a537-b33d6f7aaf7e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.380772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841faaaa-3326-4183-a537-b33d6f7aaf7e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.380962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841faaaa-3326-4183-a537-b33d6f7aaf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.409245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-841faaaa-3326-4183-a537-b33d6f7aaf7e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:45.411566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-841faaaa-3326-4183-a537-b33d6f7aaf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:45.491908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 169/348] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:45.493356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340df3a-5f21-4dee-bc5a-77e88c2c6149 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.493653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340df3a-5f21-4dee-bc5a-77e88c2c6149 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.493936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340df3a-5f21-4dee-bc5a-77e88c2c6149 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.495724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 170/349] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:45.497461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c394c-cf5b-45cf-9b20-3f0c842c3ee9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.497757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c394c-cf5b-45cf-9b20-3f0c842c3ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.498040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c394c-cf5b-45cf-9b20-3f0c842c3ee9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.499595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 171/350] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:45.500348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c394c-cf5b-45cf-9b20-3f0c842c3ee9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:45.504576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 180/351] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:45.508855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0b97-75e4-414a-968d-addfed768ad7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.509179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0b97-75e4-414a-968d-addfed768ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.509429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0b97-75e4-414a-968d-addfed768ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.528075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-feac0b97-75e4-414a-968d-addfed768ad7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:45.529298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-feac0b97-75e4-414a-968d-addfed768ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:45.554694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:45.610343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:45.616680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 181/352] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 17:46:45.618526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f3767-0601-4b6e-b52f-d715380c5725 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.618886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f3767-0601-4b6e-b52f-d715380c5725 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.624558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f3767-0601-4b6e-b52f-d715380c5725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.633331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c394c-cf5b-45cf-9b20-3f0c842c3ee9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:45.662924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-165f3767-0601-4b6e-b52f-d715380c5725 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:45.664184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-165f3767-0601-4b6e-b52f-d715380c5725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:45.695320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:45.696305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.696663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.696945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.698217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:45.699823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:45.703376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 172/353] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:45 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:45.704346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:45.758145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 182/354] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:45.759275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f3767-0601-4b6e-b52f-d715380c5725 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:45.852339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861c8d4-1560-4505-af6e-9da3af3bad48 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:45.864280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:45.895562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:45.896719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.897294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.897967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.910115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f3767-0601-4b6e-b52f-d715380c5725 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:45.911722 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:45.921660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:45.922780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:45.923613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:45.926234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 173/355] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:45.927484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:45.945500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:45.953278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:45.954340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:45.954776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:45.955201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:45.969163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:45.978346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:45.979304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:45.980151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:45.983065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 183/356] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:45.984715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:46.063972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6168-d27e-445d-97e3-f3de7a41515f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.109877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.110761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.111046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.111329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.113199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:46.114654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:46.116640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 174/357] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:45 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:46.117224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:46.131454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fe75-2310-4e63-b62a-717524e7c538 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.172930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.173863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.174237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.174580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.185078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:46.191416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:46.203275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:46.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:46:46.205167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:46.208281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 184/358] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:46.210012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:46.266423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf91843-ed78-4f34-843a-7a47cb2786e7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.272226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:46.327683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.328380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.328672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.329502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.330285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:46.330604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:46.331997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:46.345374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 175/359] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:46.345374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:46.373114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecc91d-d201-4971-95f9-d1835821d1c4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.415058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.416415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.416712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.416991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.417877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:46.418295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:46.419713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:46.429487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 185/360] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:46.430348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:46.469888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:46.475517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8edd8-ea7d-4296-ab67-449cacc5a43c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.528285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a5697-935f-4396-8e39-f3584526ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.529335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a5697-935f-4396-8e39-f3584526ac08 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.529618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a5697-935f-4396-8e39-f3584526ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.529890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a5697-935f-4396-8e39-f3584526ac08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.530748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a5697-935f-4396-8e39-f3584526ac08 None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=e270cff1485142ceb7dfa49f549bcc09) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:46.531065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a5697-935f-4396-8e39-f3584526ac08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:46.534399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a5697-935f-4396-8e39-f3584526ac08 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:46.542141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 176/361] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:46 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:46.544053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c30a-8ce7-45c8-be20-e5fd41d47fe1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.544053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c30a-8ce7-45c8-be20-e5fd41d47fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.544053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c30a-8ce7-45c8-be20-e5fd41d47fe1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.546419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 177/362] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:46.547271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56c30a-8ce7-45c8-be20-e5fd41d47fe1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:46.572688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376cc7-a983-46d6-bccb-0bde6c775c0b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.594603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:46.627847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.628984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.629277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.629830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.630621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:46.630938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:46.633339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:46.645710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 186/363] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:46.646624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:46.695039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56c30a-8ce7-45c8-be20-e5fd41d47fe1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.745387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da48ad2-61a3-4431-9a73-cd5596b261c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.746078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da48ad2-61a3-4431-9a73-cd5596b261c5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.746364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da48ad2-61a3-4431-9a73-cd5596b261c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.746692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da48ad2-61a3-4431-9a73-cd5596b261c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.791515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:46.793329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36708860-0006-4a64-b0e6-c4306172cc30 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:46.840144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:46.841204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:46.841758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:46.842061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:46.848953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da48ad2-61a3-4431-9a73-cd5596b261c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:46.850360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da48ad2-61a3-4431-9a73-cd5596b261c5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:46.943864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:46.946939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:46.949113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.018096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 178/364] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:47.020898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a78d-dc7b-4cf0-99ff-15e69f704d83 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.021188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a78d-dc7b-4cf0-99ff-15e69f704d83 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.021467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a78d-dc7b-4cf0-99ff-15e69f704d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.041718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2974a78d-dc7b-4cf0-99ff-15e69f704d83 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:47.043003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2974a78d-dc7b-4cf0-99ff-15e69f704d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:47.093407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 187/365] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:47.094806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.112924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:47.127351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 179/366] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:47.128732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974a78d-dc7b-4cf0-99ff-15e69f704d83 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.194719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:47.229818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3aae7-bfb0-47d5-8e21-1e8a2cc1d2e7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.264125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974a78d-dc7b-4cf0-99ff-15e69f704d83 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.270521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.271702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.272251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.272985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] PATH_INFO: `/v3/users/c1948648d70e4980b79e35acb02f6254` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.276503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] RBAC: Authorizing `identity:get_user(user_id=c1948648d70e4980b79e35acb02f6254)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:47.278249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.280492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 188/367] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/users/c1948648d70e4980b79e35acb02f6254 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:47.281578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.307541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.308445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.308729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.309005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.310260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:47.312336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.314969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 180/368] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:47.316323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.397775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:47.414420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64fa41-9027-4a56-8ba4-9274d1f3f292 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.457108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9432f4-8f55-4be5-8e3f-1d9f4ffe0cde None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.457542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.458681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.459164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.459649 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.461148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:47.463657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.466231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 189/369] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:47.467297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.482254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:47.502317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.503134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.503418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.504608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.517987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:47.529103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:47.530863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 181/370] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:47.532382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.652439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92520ba-7df2-4a24-9388-cf66e8a56a74 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.657922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4399b-5b0a-413a-afa5-7e666db188e5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.681979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:47.697989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.698677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.698947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.699224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.700096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] RBAC: Adding query filter params (role.id=c4f44a11e6224a609539553c6462d0cc, user.id=c1948648d70e4980b79e35acb02f6254, scope.system=all) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:47.700416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:47.701673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.702121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.703172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.703743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.704332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.705812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:47.707617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.709974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 182/371] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:47.710968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.717183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 190/372] 10.222.0.69 () {56 vars in 1308 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/role_assignments?user.id=c1948648d70e4980b79e35acb02f6254&scope.system=all&role.id=c4f44a11e6224a609539553c6462d0cc => generated 510 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:47.718107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.838585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:47.884321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf8758-9e2f-4a60-9c42-f9d625e643c8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.898271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aacb9-9c43-474f-905d-652c5b9c32d7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:47.928322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.929052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.929343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.929626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.930397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:47.931303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:47.932735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.942265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 191/373] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:47.942590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:47.943124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:47.944111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:47.944601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:47.945092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:47.947244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:47.949108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:47.951416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 183/374] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:47.956946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.037551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:48.097881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b444-90ed-4c38-a00e-14b35c2a64fa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.104721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29919c83-75d2-451a-b52f-6b65fa554576 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.137526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7483f7-9269-4a79-a502-f29aac0e03fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.137526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7483f7-9269-4a79-a502-f29aac0e03fa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.137812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7483f7-9269-4a79-a502-f29aac0e03fa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.137886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:48.138532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7483f7-9269-4a79-a502-f29aac0e03fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.147096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.148067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.148589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.148878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.149781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:48.150098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:48.152197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:48.162927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 192/375] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=2e54f04264af40db9d9999111f07233f => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:48.163811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.219812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7483f7-9269-4a79-a502-f29aac0e03fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:48.221336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7483f7-9269-4a79-a502-f29aac0e03fa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:48.286671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:48.324510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342343a-679d-4131-ab50-353f2a131f2a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.340890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 184/376] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:48.342277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7b458-225e-449d-af3d-fdf8e6799a5c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.342571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7b458-225e-449d-af3d-fdf8e6799a5c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.342955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7b458-225e-449d-af3d-fdf8e6799a5c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.348704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 185/377] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:48.355711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15275-e130-422e-a5c7-1352ca5fdd71 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.356042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15275-e130-422e-a5c7-1352ca5fdd71 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.356302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f15275-e130-422e-a5c7-1352ca5fdd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.364378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.365168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.365526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.365879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.366813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:48.367202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:48.369412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:48.376638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-87f15275-e130-422e-a5c7-1352ca5fdd71 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:48.377616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 193/378] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:48 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:48.377870 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-87f15275-e130-422e-a5c7-1352ca5fdd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:48.378491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.466747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 186/379] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:48.483699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:48.494642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f15275-e130-422e-a5c7-1352ca5fdd71 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.537534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d35e-756c-44a6-88d6-92545db04177 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.578246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.579226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.579585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.579958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] PATH_INFO: `/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.581521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] RBAC: Authorizing `identity:get_project(project_id=0ff1c526db504733a6f9bcf8c7e9e653)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:48.583065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:48.586351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 194/380] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:48 2022] GET /identity/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:48.597762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.604759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:48.623707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f15275-e130-422e-a5c7-1352ca5fdd71 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.664723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.667476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.667947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.668333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.682614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:48.691100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:48.692090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:48.692879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:48.694069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 187/381] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:48.700331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.728645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026733b-5957-4939-8d21-15316b695f04 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.767516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:48.779974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.781330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.781834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.782304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] PATH_INFO: `/v3/groups/a425814f6e344942b710a5b1c1ac2522` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.788636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] RBAC: Authorizing `identity:get_group(group_id=a425814f6e344942b710a5b1c1ac2522)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:48.791105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:48.798967 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 195/382] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:48 2022] GET /identity/v3/groups/a425814f6e344942b710a5b1c1ac2522 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:48.800337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.827291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c703-5e34-463e-a8f6-6e7479bd35ff None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.870483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.870850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.871129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.871413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.872260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:48.872596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:48.874121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:48.886222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 188/383] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:48.892092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:48.907522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:48.926258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df236d-bb0c-4693-8eed-903f55f9a44c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:48.967738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:48.968812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:48.969298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:48.969768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:48.970907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] RBAC: Adding query filter params (group.id=a425814f6e344942b710a5b1c1ac2522, role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=0ff1c526db504733a6f9bcf8c7e9e653) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:48.971420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:48.973218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:48.984153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 196/384] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:48 2022] GET /identity/v3/role_assignments?group.id=a425814f6e344942b710a5b1c1ac2522&scope.project.id=0ff1c526db504733a6f9bcf8c7e9e653&role.id=cde11b02d419404ea30981d75030a0a8 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:49.013234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4d9f3-1708-445b-9997-b36fbefccbc6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:49.058429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:49.059328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:49.059615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:49.059895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:49.061199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:49.062702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:49.064761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 189/385] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:48 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:49.070562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:49.175527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:49.254346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095552-ad29-47f0-8eea-300780445f1c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:49.305583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6d7aa-0527-41d1-bf99-da1e7d21b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:49.307421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6d7aa-0527-41d1-bf99-da1e7d21b044 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:49.307911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6d7aa-0527-41d1-bf99-da1e7d21b044 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:49.308411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6d7aa-0527-41d1-bf99-da1e7d21b044 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:49.309980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6d7aa-0527-41d1-bf99-da1e7d21b044 None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:49.311666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6d7aa-0527-41d1-bf99-da1e7d21b044 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:49.314031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 197/386] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:49 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:49.320241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:49.379598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb956-b7a9-4afa-a949-ef10392910a5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:49.380298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb956-b7a9-4afa-a949-ef10392910a5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:49.380794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb956-b7a9-4afa-a949-ef10392910a5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:49.382438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 198/387] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:46:49.395247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df808a-3347-4594-8b66-258919926d62 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:49.395540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df808a-3347-4594-8b66-258919926d62 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:49.395807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df808a-3347-4594-8b66-258919926d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:49.413740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c8df808a-3347-4594-8b66-258919926d62 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:49.415737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c8df808a-3347-4594-8b66-258919926d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:49.421242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:49.450564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb15ba6-cf9b-4bba-b09a-f15248f22ae8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:49.492317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:49.493503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:49.493940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:49.494391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09/groups/e1c40501dc4342b291d56943624c7906/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:49.497864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] RBAC: Authorizing `identity:create_grant(project_id=e270cff1485142ceb7dfa49f549bcc09, group_id=e1c40501dc4342b291d56943624c7906, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:49.499553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:49.518839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 190/388] 10.222.0.69 () {58 vars in 1442 bytes} [Thu May 26 17:46:49 2022] PUT /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09/groups/e1c40501dc4342b291d56943624c7906/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:49.568312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 199/389] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:49.609744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:49.750572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2330f5-0991-4339-887f-695ffd540f74 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:49.792637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:49.793472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:49.793763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:49.794048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:49.797354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:49.807321 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:49.816198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:49.817451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:49.818489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:49.822241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 191/390] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:49.828850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df808a-3347-4594-8b66-258919926d62 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:49.904370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:49.957974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df808a-3347-4594-8b66-258919926d62 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:49.996435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:49.997396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:49.997836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:49.998256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:49.999162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:49.999615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:50.001183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:50.016154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 200/391] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:50.018529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:50.156047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0998a-495a-4584-a945-08b10d1356d9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:50.201093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:50.202239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:50.202697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:50.203132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:50.204669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:50.206290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:50.212127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 192/392] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:50 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:50.214426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:50.325386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733369-8bf0-4504-9fa1-e29cba19769d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:50.340340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:50.362067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06b151-a617-41ac-acfc-549a30168a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:50.363277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b151-a617-41ac-acfc-549a30168a5a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:50.363761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b151-a617-41ac-acfc-549a30168a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:50.364251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b151-a617-41ac-acfc-549a30168a5a None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:50.365665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b151-a617-41ac-acfc-549a30168a5a None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:50.367306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b151-a617-41ac-acfc-549a30168a5a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:50.370134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 201/393] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:50 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:50.376134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:50.473462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:50.521506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd043fb-0518-4c7b-8dad-fda1063ccd6d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:50.561199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b6bd5-3482-4a9d-a2a6-495ad8c8e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:50.562388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b6bd5-3482-4a9d-a2a6-495ad8c8e487 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:50.562884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b6bd5-3482-4a9d-a2a6-495ad8c8e487 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:50.563335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b6bd5-3482-4a9d-a2a6-495ad8c8e487 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09/groups/e1c40501dc4342b291d56943624c7906/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:50.565807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b6bd5-3482-4a9d-a2a6-495ad8c8e487 None admin] RBAC: Authorizing `identity:create_grant(project_id=e270cff1485142ceb7dfa49f549bcc09, group_id=e1c40501dc4342b291d56943624c7906, role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:50.567443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b6bd5-3482-4a9d-a2a6-495ad8c8e487 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:50.583505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 193/394] 10.222.0.69 () {58 vars in 1442 bytes} [Thu May 26 17:46:50 2022] PUT /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09/groups/e1c40501dc4342b291d56943624c7906/roles/cdcd22caf11c40b490d53fab54878c23 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:46:51.403624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c72b8-3818-4066-8681-c05a7a22d3ab None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:51.404679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c72b8-3818-4066-8681-c05a7a22d3ab None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:51.405164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c72b8-3818-4066-8681-c05a7a22d3ab None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:51.407038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 202/395] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:51.413138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d07a9-024a-4a3e-887c-8c3824bf3945 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:51.414017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d07a9-024a-4a3e-887c-8c3824bf3945 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:51.414496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d07a9-024a-4a3e-887c-8c3824bf3945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:51.432623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a82d07a9-024a-4a3e-887c-8c3824bf3945 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:51.434150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a82d07a9-024a-4a3e-887c-8c3824bf3945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:51.468041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadefc32-ed08-419e-acb8-0d9504d90d60 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:51.468041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadefc32-ed08-419e-acb8-0d9504d90d60 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:51.468041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadefc32-ed08-419e-acb8-0d9504d90d60 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:51.470269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 203/396] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:51.474992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dd21f-96ef-471e-9e42-f08b232263b6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:51.475561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dd21f-96ef-471e-9e42-f08b232263b6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:51.476114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dd21f-96ef-471e-9e42-f08b232263b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:51.503612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b12dd21f-96ef-471e-9e42-f08b232263b6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:51.506589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b12dd21f-96ef-471e-9e42-f08b232263b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:51.545611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 194/397] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:51.575552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d07a9-024a-4a3e-887c-8c3824bf3945 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:51.627214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 204/398] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:51.663559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dd21f-96ef-471e-9e42-f08b232263b6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:51.699216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:51.807248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dd21f-96ef-471e-9e42-f08b232263b6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:51.824429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:51.825974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d07a9-024a-4a3e-887c-8c3824bf3945 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:51.850457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:51.851659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:51.852592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:51.853304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:51.865760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:51.874931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:51.875799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:51.876602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:51.878713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 205/399] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:51.884963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:51.920211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:51.921544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:51.923279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:51.923961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:51.955725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:51.972866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:51.973795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:51.974618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:51.983647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 195/400] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:51.989177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.068827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5cf5-01ba-4ef1-8ae6-6f313d6ff894 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.114045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd0755-e9d4-43ca-90be-41d8b97310b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.115206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd0755-e9d4-43ca-90be-41d8b97310b7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.117044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd0755-e9d4-43ca-90be-41d8b97310b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.117844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd0755-e9d4-43ca-90be-41d8b97310b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.120500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd0755-e9d4-43ca-90be-41d8b97310b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:52.121041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd0755-e9d4-43ca-90be-41d8b97310b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.122643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd0755-e9d4-43ca-90be-41d8b97310b7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.137814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 206/401] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:52.139137 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ebb7-801d-4535-902b-c3dc5f8aa31a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.139430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ebb7-801d-4535-902b-c3dc5f8aa31a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.139712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ebb7-801d-4535-902b-c3dc5f8aa31a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.141332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 207/402] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:52.142066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ebb7-801d-4535-902b-c3dc5f8aa31a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.186559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:52.196889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2c527-444e-4c37-a799-50f5872fbed9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.213140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:52.236491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5a397-ffc4-4dfe-870d-279b4d72c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.237385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a397-ffc4-4dfe-870d-279b4d72c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.237807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a397-ffc4-4dfe-870d-279b4d72c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.238313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a397-ffc4-4dfe-870d-279b4d72c5e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.239333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5a397-ffc4-4dfe-870d-279b4d72c5e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:52.239849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5a397-ffc4-4dfe-870d-279b4d72c5e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.241447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5a397-ffc4-4dfe-870d-279b4d72c5e1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.252074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 196/403] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:52.253869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f035fcf-3ede-46c4-9d7f-a504c387ed64 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.254354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f035fcf-3ede-46c4-9d7f-a504c387ed64 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.254849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f035fcf-3ede-46c4-9d7f-a504c387ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.275342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1f035fcf-3ede-46c4-9d7f-a504c387ed64 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:52.276213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ebb7-801d-4535-902b-c3dc5f8aa31a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.277223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1f035fcf-3ede-46c4-9d7f-a504c387ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:52.313455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.314335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.314625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.314970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.316263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.318478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.324606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 208/404] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:52 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:52.324606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.358456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 197/405] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:52.359818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f035fcf-3ede-46c4-9d7f-a504c387ed64 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.429662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0be9-c02a-49d2-a8f6-ee678b178a8a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.431980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:52.469905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.470661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.470942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.471215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.472456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.473900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.475569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 209/406] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:52 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:52.476325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.478122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f035fcf-3ede-46c4-9d7f-a504c387ed64 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.486965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:52.519214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.520545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.521049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.521567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.523349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.525561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.527910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 198/407] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:52 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:52.528986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.589240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bba08-050a-4128-9a64-a7ea9c3a8f8a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.627298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.628163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.628453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.628736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.641489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:52.645778 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d308-150d-40e2-835e-f6719fe1b5b8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:52.649960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:52.650862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:52.651638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 210/408] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:52.652764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.685304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:52.691644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.692800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.693283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.693751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.695184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.697541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.699924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 199/409] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:52 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:52.700952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.749052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:52.766964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c96f9-c134-469c-aca8-53ed22f973b1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.803593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.804526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.804814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.805099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/groups/e1c40501dc4342b291d56943624c7906/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.808230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] RBAC: Authorizing `identity:create_grant(project_id=1664139aa3df4640a7ea00dfab7c3bb1, group_id=e1c40501dc4342b291d56943624c7906, role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.809697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.817235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105f4cf-f5b6-4cd6-b99e-ded35f46f8f2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:52.831032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 211/410] 10.222.0.69 () {58 vars in 1442 bytes} [Thu May 26 17:46:52 2022] PUT /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/groups/e1c40501dc4342b291d56943624c7906/roles/cdcd22caf11c40b490d53fab54878c23 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:52.831032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.861755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3986c-e78e-4315-b4d2-6d08341ad5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:52.862443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3986c-e78e-4315-b4d2-6d08341ad5ba None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.862846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3986c-e78e-4315-b4d2-6d08341ad5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.863123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3986c-e78e-4315-b4d2-6d08341ad5ba None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.863907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3986c-e78e-4315-b4d2-6d08341ad5ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:52.864298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3986c-e78e-4315-b4d2-6d08341ad5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:52.865896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3986c-e78e-4315-b4d2-6d08341ad5ba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:52.879867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 200/411] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:52.881075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ffa8-be21-41e1-bdaf-434a18a1da26 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:52.881364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ffa8-be21-41e1-bdaf-434a18a1da26 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:52.881638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ffa8-be21-41e1-bdaf-434a18a1da26 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:52.887114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 201/412] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:52.887114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008ffa8-be21-41e1-bdaf-434a18a1da26 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:52.962436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:52.977110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdba0b-7e61-459a-9b07-78d847533e0a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:53.026282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2527e7-04aa-432e-8f7d-547b82ccc2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:53.027553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2527e7-04aa-432e-8f7d-547b82ccc2f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.028733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2527e7-04aa-432e-8f7d-547b82ccc2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.029245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2527e7-04aa-432e-8f7d-547b82ccc2f4 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/groups/e1c40501dc4342b291d56943624c7906/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.033791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2527e7-04aa-432e-8f7d-547b82ccc2f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1664139aa3df4640a7ea00dfab7c3bb1, group_id=e1c40501dc4342b291d56943624c7906, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:53.036642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2527e7-04aa-432e-8f7d-547b82ccc2f4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:53.044006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008ffa8-be21-41e1-bdaf-434a18a1da26 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:53.047459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:53.056054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 212/413] 10.222.0.69 () {58 vars in 1442 bytes} [Thu May 26 17:46:52 2022] PUT /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1/groups/e1c40501dc4342b291d56943624c7906/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:53.059911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c1c4-9343-4dfe-9147-05bc39544b98 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.059911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c1c4-9343-4dfe-9147-05bc39544b98 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.059911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c1c4-9343-4dfe-9147-05bc39544b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.075816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c133c1c4-9343-4dfe-9147-05bc39544b98 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:53.077134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c133c1c4-9343-4dfe-9147-05bc39544b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:53.103258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:53.104958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.105248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.105824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] PATH_INFO: `/v3/groups/a425814f6e344942b710a5b1c1ac2522` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.107449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] RBAC: Authorizing `identity:get_group(group_id=a425814f6e344942b710a5b1c1ac2522)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:53.110098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:53.112421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 202/414] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:52 2022] GET /identity/v3/groups/a425814f6e344942b710a5b1c1ac2522 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:53.118456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:53.202854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 213/415] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:53.234925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c1c4-9343-4dfe-9147-05bc39544b98 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:53.324753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528af-9a40-437c-94e9-4ac7eec61c13 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:53.350267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:53.377095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c1c4-9343-4dfe-9147-05bc39544b98 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:53.382160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:53.385071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.385462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.385888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] PATH_INFO: `/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.387270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] RBAC: Authorizing `identity:get_project(project_id=0ff1c526db504733a6f9bcf8c7e9e653)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:53.389340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:53.392253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 203/416] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:53 2022] GET /identity/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653 => generated 344 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:53.398277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:53.441586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a54e7-d038-4bd2-82f3-3278cd2dbcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:53.442397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a54e7-d038-4bd2-82f3-3278cd2dbcec None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.442685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a54e7-d038-4bd2-82f3-3278cd2dbcec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.442964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a54e7-d038-4bd2-82f3-3278cd2dbcec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.467297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a54e7-d038-4bd2-82f3-3278cd2dbcec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:53.475969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-784a54e7-d038-4bd2-82f3-3278cd2dbcec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:53.480330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:53.481240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:53.482063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 214/417] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:53.482908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b52ca-5f2f-4c8d-b8a2-03fab175ed79 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.483204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b52ca-5f2f-4c8d-b8a2-03fab175ed79 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.483482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b52ca-5f2f-4c8d-b8a2-03fab175ed79 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.485183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 215/418] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:53.490725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7501d32-71e0-4f06-818e-770f5d0b5f6b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.491016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7501d32-71e0-4f06-818e-770f5d0b5f6b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.491301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7501d32-71e0-4f06-818e-770f5d0b5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.509004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d7501d32-71e0-4f06-818e-770f5d0b5f6b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:53.510220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d7501d32-71e0-4f06-818e-770f5d0b5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:53.547974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84dda-08ae-4f9f-8711-5b674d7e89b2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:53.588766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 216/419] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:53.589786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7501d32-71e0-4f06-818e-770f5d0b5f6b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:53.616853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:53.617967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.618374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.618656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] PATH_INFO: `/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653/groups/a425814f6e344942b710a5b1c1ac2522/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.620756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] RBAC: Authorizing `identity:create_grant(project_id=0ff1c526db504733a6f9bcf8c7e9e653, group_id=a425814f6e344942b710a5b1c1ac2522, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:53.622220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:53.648401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 204/420] 10.222.0.69 () {58 vars in 1442 bytes} [Thu May 26 17:46:53 2022] PUT /identity/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653/groups/a425814f6e344942b710a5b1c1ac2522/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:46:53.650589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:53.672954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:53.709206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7501d32-71e0-4f06-818e-770f5d0b5f6b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:53.778548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:53.779246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.779536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.779815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.780615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:53.780931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:53.784187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:53.802983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 217/421] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:53.808996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:53.872418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:53.879580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d8aa8-7cf8-459b-84ac-b47df05b3efd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:53.929046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:53.930011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:53.931064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:53.931346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:53.947193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:53.957893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:53.958795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:53.964433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 205/422] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:53.966546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:53.985371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5822731-1f48-429e-955f-bf25baedbea9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.017652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:54.023844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:54.024543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:54.024897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:54.025205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:54.079205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1d23b-8cb3-4afe-9f24-e440539b4c57 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.098958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:54.100472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:54.118643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:54.119717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:54.120224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:54.120645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:54.121572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:54.122036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:54.123686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:54.137976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 206/423] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:54.139764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:54.178895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:54.214834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 218/424] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:54.225136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:54.263376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f02fe-950d-4593-83f2-b3ad79f17a31 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.285014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:54.300646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:54.301547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:54.301987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:54.302511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:54.374829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:54.376582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:54.442563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:54.458517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df5a3a-7e7d-45db-bca3-560795a9024f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.502160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 207/425] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:46:54.506156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:54.533385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:54.535024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:54.535458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:54.535879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:54.537264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:54.538879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:54.541936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 219/426] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:54 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:54.548786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:54.681113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2b6b-f1b5-4743-836d-bf3a91aca5f4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.685275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:54.692380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847fe76-a7b4-4b87-947b-8d74750a7e4b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.718213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:54.719093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:54.719385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:54.719668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:54.720910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:54.722376 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:54.724339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 220/427] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:54 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:54.736916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:54.737831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:54.750257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:54.756595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:54.756595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:54.756595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] PATH_INFO: `/v3/projects/e270cff1485142ceb7dfa49f549bcc09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:54.756595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] RBAC: Authorizing `identity:get_project(project_id=e270cff1485142ceb7dfa49f549bcc09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:54.756595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:54.762104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 208/428] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:54 2022] GET /identity/v3/projects/e270cff1485142ceb7dfa49f549bcc09 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:54.765271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:54.899536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598dcca-cf7c-444d-a2ec-5682a9bbed0f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.935949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefd60a-4ab6-42b8-9525-318e80a35861 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:54.942281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:54.943150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:54.943431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:54.943705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:54.947705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:54.949218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:54.956370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 209/429] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:54 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:54.974644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:55.028223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d3e1-9e0b-4008-bd57-c967021d1e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:55.029318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d3e1-9e0b-4008-bd57-c967021d1e1b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:55.029803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d3e1-9e0b-4008-bd57-c967021d1e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:55.030274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d3e1-9e0b-4008-bd57-c967021d1e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:55.031338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d3e1-9e0b-4008-bd57-c967021d1e1b None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=e270cff1485142ceb7dfa49f549bcc09) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:55.031852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d3e1-9e0b-4008-bd57-c967021d1e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:55.033540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d3e1-9e0b-4008-bd57-c967021d1e1b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:55.040626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:55.053119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 221/430] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:54 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=2e54f04264af40db9d9999111f07233f => generated 611 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:55.106624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b302-9a5d-42db-a4c1-fef49cdf9abd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:55.160199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d25a-8e81-419d-8175-e3b56c884211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:55.160869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d25a-8e81-419d-8175-e3b56c884211 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:55.161162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d25a-8e81-419d-8175-e3b56c884211 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:55.161439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d25a-8e81-419d-8175-e3b56c884211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:55.162286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d25a-8e81-419d-8175-e3b56c884211 None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=e270cff1485142ceb7dfa49f549bcc09) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:55.162599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d25a-8e81-419d-8175-e3b56c884211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:55.164092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d25a-8e81-419d-8175-e3b56c884211 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:55.171340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 210/431] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:54 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=e270cff1485142ceb7dfa49f549bcc09&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:55.486314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80350-7c58-48ae-a1bb-047046b64f92 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:55.486818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80350-7c58-48ae-a1bb-047046b64f92 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:55.486890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80350-7c58-48ae-a1bb-047046b64f92 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:55.488314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 222/432] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:55.494174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee727fc-741f-4edc-81d0-7ed58090448f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:55.494468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee727fc-741f-4edc-81d0-7ed58090448f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:55.494751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee727fc-741f-4edc-81d0-7ed58090448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:55.515910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fee727fc-741f-4edc-81d0-7ed58090448f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:55.517244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fee727fc-741f-4edc-81d0-7ed58090448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:55.599367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 211/433] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:55.622954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc80350-7c58-48ae-a1bb-047046b64f92 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:55.660663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:55.726141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f961a-6f71-4861-8696-37372a4d3b21 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:55.726657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f961a-6f71-4861-8696-37372a4d3b21 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:55.726773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f961a-6f71-4861-8696-37372a4d3b21 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:55.728384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 212/434] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:55.736770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce64ce-2698-40ab-b49f-ce4c978df767 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:55.736985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce64ce-2698-40ab-b49f-ce4c978df767 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:55.737264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce64ce-2698-40ab-b49f-ce4c978df767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:55.740073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc80350-7c58-48ae-a1bb-047046b64f92 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:55.761199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-afce64ce-2698-40ab-b49f-ce4c978df767 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:55.762420 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-afce64ce-2698-40ab-b49f-ce4c978df767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:55.795906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:55.797046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:55.797337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:55.797613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:55.812258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:55.822579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:55.823492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:55.824411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 223/435] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:46:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:55.830571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:55.836133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:55.872042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 213/436] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:46:55.893523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce64ce-2698-40ab-b49f-ce4c978df767 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:55.955591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:55.966880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890530f8-cc89-4491-b2ad-80b3ddf2f850 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.004455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.005043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.005328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.005603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.006348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:56.006657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.008058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.014492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce64ce-2698-40ab-b49f-ce4c978df767 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.017763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 224/437] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:46:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:56.023427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.053845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.054664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.054947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.055846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.066330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:56.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:56.075707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:46:56.076676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 214/438] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:46:56.081648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.126847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.135703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74510629-a56d-4899-9686-5900eecbe42f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.174759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.175457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.175741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.176045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.200846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69ed8-e85d-411e-86b0-6dd226fa212e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.202663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.237373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.238048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.238343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.238613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.239379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:56.239693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.241198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.251060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 215/439] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:56.256629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.256972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.259181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.367505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31edeca-4d3f-414f-84fb-193a3ccb29d8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.369548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 225/440] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:46:56.371852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.375232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.408853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ed5a-1b72-4927-a7cf-2a02fdb5e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.409513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ed5a-1b72-4927-a7cf-2a02fdb5e16f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.410051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ed5a-1b72-4927-a7cf-2a02fdb5e16f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.410334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ed5a-1b72-4927-a7cf-2a02fdb5e16f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.434516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.487079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e352-581d-4685-8905-140e9e445f09 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.494773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02ed5a-1b72-4927-a7cf-2a02fdb5e16f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.496318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02ed5a-1b72-4927-a7cf-2a02fdb5e16f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.527115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df2f18-2ee1-439d-9100-40ba178ecf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.527913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df2f18-2ee1-439d-9100-40ba178ecf83 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.528233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df2f18-2ee1-439d-9100-40ba178ecf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.528511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df2f18-2ee1-439d-9100-40ba178ecf83 None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.529794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df2f18-2ee1-439d-9100-40ba178ecf83 None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.531383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df2f18-2ee1-439d-9100-40ba178ecf83 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.533302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 226/441] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:56.534469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d401-68b6-49df-8a6a-fc9aec353c54 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.534756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d401-68b6-49df-8a6a-fc9aec353c54 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.535032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d401-68b6-49df-8a6a-fc9aec353c54 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.536507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 227/442] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:46:56.538496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6d401-68b6-49df-8a6a-fc9aec353c54 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.609679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 216/443] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:46:56.610984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d4490-393a-4840-9f85-f0f1af7b6bf9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.611280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d4490-393a-4840-9f85-f0f1af7b6bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.611564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d4490-393a-4840-9f85-f0f1af7b6bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.617311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.632946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bf6d4490-393a-4840-9f85-f0f1af7b6bf9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:46:56.634892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bf6d4490-393a-4840-9f85-f0f1af7b6bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:46:56.656197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6d401-68b6-49df-8a6a-fc9aec353c54 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.682823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.697677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.698545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.698828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.699107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.700349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.701774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.703554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 228/444] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:56.704218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.712368 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 217/445] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:46:56.713206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d4490-393a-4840-9f85-f0f1af7b6bf9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.816999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666fb69-8274-4a69-9ec4-a0db707cb7dc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.819948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d4490-393a-4840-9f85-f0f1af7b6bf9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:56.849549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.850414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.850698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.850973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] PATH_INFO: `/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.852842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] RBAC: Authorizing `identity:get_project(project_id=1664139aa3df4640a7ea00dfab7c3bb1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.854288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.854858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:56.855503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:56.855786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:56.860490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:56.860623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 229/446] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/projects/1664139aa3df4640a7ea00dfab7c3bb1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:56.860623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.860795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:56.860795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:56.860795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:56.860795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.866006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 218/447] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:56.866782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:56.923670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:56.975594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb92d4-acb0-45b7-b552-d0af0916904f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.000714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c7645-e6c3-4a45-b8bf-7b68b0803bf1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.013235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.014050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.014339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.014620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.028604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:46:57.036512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:46:57.037654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:46:57.038525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 230/448] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:46:57.042332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.043393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.043685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.043966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] PATH_INFO: `/v3/groups/e1c40501dc4342b291d56943624c7906` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.044562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:57.045212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] RBAC: Authorizing `identity:get_group(group_id=e1c40501dc4342b291d56943624c7906)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:57.047351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:57.049288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 219/449] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:56 2022] GET /identity/v3/groups/e1c40501dc4342b291d56943624c7906 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:57.054755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:57.130986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:57.156477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9ea76-7375-44df-a945-76afabfc2d2d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.167818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70c850-d37c-4764-b6a4-ff47bf67500c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.172764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:57.189326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.190006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.190288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.190560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.191320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:57.191631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:57.193155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:57.201621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.201761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 231/450] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:57.202283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.202571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.202854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.203688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] RBAC: Adding query filter params (group.id=e1c40501dc4342b291d56943624c7906, role.id=2e54f04264af40db9d9999111f07233f, scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:57.204004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:57.205477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:57.207319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:57.223379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 220/451] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:57 2022] GET /identity/v3/role_assignments?group.id=e1c40501dc4342b291d56943624c7906&scope.project.id=1664139aa3df4640a7ea00dfab7c3bb1&role.id=2e54f04264af40db9d9999111f07233f => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:46:57.313885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302c8ac-f8a9-430f-b122-e2acb0a22338 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.349514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.350177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.350469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.350748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.401741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:57.424391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:57.425975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:57.529943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 232/452] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:46:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:46:57.535848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:57.640177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11294b18-a2b9-460f-8895-dc0c938f998c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.669449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:57.675449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.676546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.676830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.677117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] PATH_INFO: `/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.678323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] RBAC: Authorizing `identity:get_project(project_id=0ff1c526db504733a6f9bcf8c7e9e653)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:57.679769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:57.682013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 221/453] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:46:57 2022] GET /identity/v3/projects/0ff1c526db504733a6f9bcf8c7e9e653 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:57.687722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:57.771468 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:46:57.790824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c8d0f-30f8-48a4-9b9e-a87f7433729b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.824470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ddc9-5158-449c-83fc-51c3da126165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.825321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ddc9-5158-449c-83fc-51c3da126165 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.825609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ddc9-5158-449c-83fc-51c3da126165 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.825890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ddc9-5158-449c-83fc-51c3da126165 None admin] PATH_INFO: `/v3/groups/a425814f6e344942b710a5b1c1ac2522` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.827053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ddc9-5158-449c-83fc-51c3da126165 None admin] RBAC: Authorizing `identity:get_group(group_id=a425814f6e344942b710a5b1c1ac2522)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:57.828582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ddc9-5158-449c-83fc-51c3da126165 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:57.830189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 233/454] 10.222.0.69 () {56 vars in 1180 bytes} [Thu May 26 17:46:57 2022] GET /identity/v3/groups/a425814f6e344942b710a5b1c1ac2522 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:46:57.836120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:46:57.934664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d382e4-a90f-474e-9e4b-882f5e030520 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:46:57.966444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33629-8a57-487d-a938-1b1eded8c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:46:57.967088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33629-8a57-487d-a938-1b1eded8c777 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:46:57.967377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33629-8a57-487d-a938-1b1eded8c777 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:46:57.967663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33629-8a57-487d-a938-1b1eded8c777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:46:57.968529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33629-8a57-487d-a938-1b1eded8c777 None admin] RBAC: Adding query filter params (group.id=a425814f6e344942b710a5b1c1ac2522, role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=0ff1c526db504733a6f9bcf8c7e9e653) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:46:57.968848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33629-8a57-487d-a938-1b1eded8c777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:46:57.970283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33629-8a57-487d-a938-1b1eded8c777 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:46:57.975934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 222/455] 10.222.0.69 () {56 vars in 1376 bytes} [Thu May 26 17:46:57 2022] GET /identity/v3/role_assignments?group.id=a425814f6e344942b710a5b1c1ac2522&scope.project.id=0ff1c526db504733a6f9bcf8c7e9e653&role.id=cde11b02d419404ea30981d75030a0a8 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:00.755853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277492-0a2b-4d9b-866d-a5afcb9196e5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:00.761521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277492-0a2b-4d9b-866d-a5afcb9196e5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:00.762034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277492-0a2b-4d9b-866d-a5afcb9196e5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:00.763954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 234/456] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:00.769726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821c0c-0ed0-4713-a031-b45f234700d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:00.770571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821c0c-0ed0-4713-a031-b45f234700d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:00.771073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821c0c-0ed0-4713-a031-b45f234700d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:00.774887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04bef-dc43-4a94-997e-57d75caf1e47 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:00.777946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04bef-dc43-4a94-997e-57d75caf1e47 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:00.778435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04bef-dc43-4a94-997e-57d75caf1e47 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:00.781259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 235/457] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:00.790290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177a44-3981-49ca-b7de-4fd2becf3ee9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:00.791018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177a44-3981-49ca-b7de-4fd2becf3ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:00.791525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a177a44-3981-49ca-b7de-4fd2becf3ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:00.794512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b5821c0c-0ed0-4713-a031-b45f234700d0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:00.795976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5821c0c-0ed0-4713-a031-b45f234700d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:00.821628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1a177a44-3981-49ca-b7de-4fd2becf3ee9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:00.822946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1a177a44-3981-49ca-b7de-4fd2becf3ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:00.865742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:00.902028 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 223/458] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:00.943990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 236/459] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:47:00.949075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5821c0c-0ed0-4713-a031-b45f234700d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:00.969124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177a44-3981-49ca-b7de-4fd2becf3ee9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:01.108134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5821c0c-0ed0-4713-a031-b45f234700d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:01.120476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:01.159610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:01.160465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.160743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.161613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.174035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:01.175726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:01.193958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a177a44-3981-49ca-b7de-4fd2becf3ee9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:01.199127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:01.199977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:01.201070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:01.201070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:01.201070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:01.201070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:01.201317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 224/460] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:01.208080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:01.239751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265137b6-38c6-4a96-967c-e4430c61880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:01.240842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265137b6-38c6-4a96-967c-e4430c61880e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.241353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265137b6-38c6-4a96-967c-e4430c61880e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.241830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265137b6-38c6-4a96-967c-e4430c61880e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.253323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265137b6-38c6-4a96-967c-e4430c61880e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:01.255204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265137b6-38c6-4a96-967c-e4430c61880e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:01.259361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-265137b6-38c6-4a96-967c-e4430c61880e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:01.277986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:01.279031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:01.280114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:01.280114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:01.280114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:01.280114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:01.282251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 237/461] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:01.283923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9faaf0-2279-4c10-906a-39b30b94accd None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.284394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9faaf0-2279-4c10-906a-39b30b94accd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.284831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9faaf0-2279-4c10-906a-39b30b94accd None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.291969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 238/462] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:01.293279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9faaf0-2279-4c10-906a-39b30b94accd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:01.319565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3c85-002c-4bb3-ae1a-7f7d1efe3ed2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:01.362933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb6a02-1e45-489f-bd2f-6da71f6ab5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:01.363514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6a02-1e45-489f-bd2f-6da71f6ab5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.363808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6a02-1e45-489f-bd2f-6da71f6ab5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.364119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb6a02-1e45-489f-bd2f-6da71f6ab5d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.364853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb6a02-1e45-489f-bd2f-6da71f6ab5d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:01.365168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb6a02-1e45-489f-bd2f-6da71f6ab5d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:01.366784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb6a02-1e45-489f-bd2f-6da71f6ab5d0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:01.378780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 225/463] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:01.380100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb45a-9b44-4bfe-97a4-0131cadd0e8b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.380396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb45a-9b44-4bfe-97a4-0131cadd0e8b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.380679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb45a-9b44-4bfe-97a4-0131cadd0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.398030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9feeb45a-9b44-4bfe-97a4-0131cadd0e8b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:01.399819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9feeb45a-9b44-4bfe-97a4-0131cadd0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:01.414358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9faaf0-2279-4c10-906a-39b30b94accd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:01.447912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:01.455710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:01.456459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.456743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.457179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.457749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:01.458059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:01.459426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:01.475210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 226/464] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:01.478313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c003-85a1-4e6d-9f89-3e158f274db2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.480058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 239/465] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:01.480058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:01.480541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c003-85a1-4e6d-9f89-3e158f274db2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.480977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c003-85a1-4e6d-9f89-3e158f274db2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.482716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 227/466] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:01.483733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581c003-85a1-4e6d-9f89-3e158f274db2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:01.533732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:01.608434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2294-fa71-44ab-83fe-46a156ea8d8c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:01.612859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581c003-85a1-4e6d-9f89-3e158f274db2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:01.649182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586c028-ae8d-4bd7-ab7c-8e427d676f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:01.650172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586c028-ae8d-4bd7-ab7c-8e427d676f22 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.650630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586c028-ae8d-4bd7-ab7c-8e427d676f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.650915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586c028-ae8d-4bd7-ab7c-8e427d676f22 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.651631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586c028-ae8d-4bd7-ab7c-8e427d676f22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:01.653116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586c028-ae8d-4bd7-ab7c-8e427d676f22 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:01.655887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:01.656588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.656879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.657157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.657870 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:01.659296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:01.684057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 240/467] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:47:01 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:01.684057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9652-3567-4e34-b760-7b97b047c817 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.684057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9652-3567-4e34-b760-7b97b047c817 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.684057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9652-3567-4e34-b760-7b97b047c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.696824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 228/468] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:47:01 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:47:01.697965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:01.705076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-97fb9652-3567-4e34-b760-7b97b047c817 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:01.708947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-97fb9652-3567-4e34-b760-7b97b047c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:01.808499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:01.859593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 241/469] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:01.888434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:01.897145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9652-3567-4e34-b760-7b97b047c817 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:01.914112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b73fa-3f53-45ba-a213-be7c9cdeb3ae None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:01.958578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:01.959841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:01.960690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:01.960690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:01.974788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:01.976575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:01.998041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:01.999164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:02.000167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:02.000167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:02.000167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:02.000167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:02.000167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 229/470] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:02.005319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:02.043932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9652-3567-4e34-b760-7b97b047c817 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:02.092732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:02.093625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.093913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.094194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.107302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:02.108830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:02.135412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffc3d-1cdd-4cbc-8972-36a63e668cb0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:02.136540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:02.137357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:02.138217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:02.138217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:02.138217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:02.138217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:02.143159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 242/471] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:02.153476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:02.178264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd735f-eaa1-4f96-838b-dea7a5596a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:02.179168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd735f-eaa1-4f96-838b-dea7a5596a45 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.180146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd735f-eaa1-4f96-838b-dea7a5596a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.180438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd735f-eaa1-4f96-838b-dea7a5596a45 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.181370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd735f-eaa1-4f96-838b-dea7a5596a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:02.181681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd735f-eaa1-4f96-838b-dea7a5596a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:02.183119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd735f-eaa1-4f96-838b-dea7a5596a45 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:02.197336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 230/472] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:02.198760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3abd10-c53b-4110-bb01-ccbf91d6d58d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.199077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3abd10-c53b-4110-bb01-ccbf91d6d58d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.199380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3abd10-c53b-4110-bb01-ccbf91d6d58d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.204060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 231/473] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:02.205523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3abd10-c53b-4110-bb01-ccbf91d6d58d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:02.209727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:02.216633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:02.297128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94757c4b-53bc-4a71-b539-51dd97fdd6b2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:02.335437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3abd10-c53b-4110-bb01-ccbf91d6d58d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:02.341450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cc47a-3f50-4951-bad6-fa6801aed08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:02.342135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cc47a-3f50-4951-bad6-fa6801aed08c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.342455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cc47a-3f50-4951-bad6-fa6801aed08c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.342738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cc47a-3f50-4951-bad6-fa6801aed08c None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.343485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cc47a-3f50-4951-bad6-fa6801aed08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:02.343796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cc47a-3f50-4951-bad6-fa6801aed08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:02.345216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cc47a-3f50-4951-bad6-fa6801aed08c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:02.362793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 243/474] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:02.364624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41866-8644-4b59-aa74-e7f636e42c12 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.364921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41866-8644-4b59-aa74-e7f636e42c12 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.365207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41866-8644-4b59-aa74-e7f636e42c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.387220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c9e41866-8644-4b59-aa74-e7f636e42c12 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:02.388272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:02.389111 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c9e41866-8644-4b59-aa74-e7f636e42c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:02.389847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.390189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.390475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.391197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:02.394388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:02.436185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 232/475] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:47:02 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:02.436185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:02.512415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:02.543303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 244/476] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:02.587416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9da4-3a26-41f8-b091-8dd831a1be5a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:02.591912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e41866-8644-4b59-aa74-e7f636e42c12 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:02.633917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:02.633917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.633917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.633917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.634794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:02.635553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:02.637806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:02.669475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 233/477] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:47:02 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:02.750349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e41866-8644-4b59-aa74-e7f636e42c12 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:02.798122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:02.798888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:02.799181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:02.799465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:02.800403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:02.801875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:02.811127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.sql.core [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 17:47:02.811127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 17:47:02.811127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [parameters: {'id': '5e2215731e7e40c3ac89da6937460594', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 17:47:02.811127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80193) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() May 26 17:47:02.830293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return ref.to_dict() May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:47:02.831230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application yield resource May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.rollback() May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.force_reraise() May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise self.value May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application session.commit() May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 17:47:02.832161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._prepare_impl() May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.flush() May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._flush(objects) May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application compat.raise_( May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application flush_context.execute() May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rec.execute(self) May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 17:47:02.833244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:47:02.834106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:47:02.834879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [parameters: {'id': '5e2215731e7e40c3ac89da6937460594', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:02.835640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 17:47:02.840409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:02.842301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 245/478] 10.222.0.69 () {60 vars in 1131 bytes} [Thu May 26 17:47:02 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:02.842428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:02.972537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488ca2-607d-4a52-abb2-c86497693835 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:02.988824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:03.014964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6937cf-7a17-4f87-ae6e-caedc531175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:03.015902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6937cf-7a17-4f87-ae6e-caedc531175b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:03.016223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6937cf-7a17-4f87-ae6e-caedc531175b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:03.016526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6937cf-7a17-4f87-ae6e-caedc531175b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:03.029179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6937cf-7a17-4f87-ae6e-caedc531175b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8c6937cf-7a17-4f87-ae6e-caedc531175b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:03.037477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:03.038350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:03.039161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 234/479] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:03.044343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:03.134421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:03.154091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504f15-d03c-42aa-9209-61bc6eeacc92 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:03.189685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605ad55-d7b1-4598-8204-996d61e8d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:03.190367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605ad55-d7b1-4598-8204-996d61e8d2bc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:03.190658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605ad55-d7b1-4598-8204-996d61e8d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:03.191004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605ad55-d7b1-4598-8204-996d61e8d2bc None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:03.191773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605ad55-d7b1-4598-8204-996d61e8d2bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:03.192170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605ad55-d7b1-4598-8204-996d61e8d2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:03.193550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605ad55-d7b1-4598-8204-996d61e8d2bc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:03.202767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 246/480] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:04.611388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0476b-d479-4972-8313-dab1b6a9ebd3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:04.611914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0476b-d479-4972-8313-dab1b6a9ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:04.612284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0476b-d479-4972-8313-dab1b6a9ebd3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:04.614051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 235/481] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:04.619337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd80f9d-3de3-4cf1-acab-0e4fa845976a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:04.619765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd80f9d-3de3-4cf1-acab-0e4fa845976a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:04.619905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd80f9d-3de3-4cf1-acab-0e4fa845976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:04.637612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7fd80f9d-3de3-4cf1-acab-0e4fa845976a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:04.638813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7fd80f9d-3de3-4cf1-acab-0e4fa845976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:04.688692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f41d5-7c0a-4b1b-aa9b-77799e24a6b4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:04.688991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f41d5-7c0a-4b1b-aa9b-77799e24a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:04.689256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f41d5-7c0a-4b1b-aa9b-77799e24a6b4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:04.690878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 236/482] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:04.696590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d61b7-360e-4c29-9515-a665f73e14d2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:04.696895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d61b7-360e-4c29-9515-a665f73e14d2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:04.697182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d61b7-360e-4c29-9515-a665f73e14d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:04.721741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-763d61b7-360e-4c29-9515-a665f73e14d2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:04.723232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-763d61b7-360e-4c29-9515-a665f73e14d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:04.738653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 247/483] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:04.800838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd80f9d-3de3-4cf1-acab-0e4fa845976a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:04.828953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 237/484] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:04.869794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d61b7-360e-4c29-9515-a665f73e14d2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:04.901070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:04.958766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd80f9d-3de3-4cf1-acab-0e4fa845976a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:04.977699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d61b7-360e-4c29-9515-a665f73e14d2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:04.980675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:05.032527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.033714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.034719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.035192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.039663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.041532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.044154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.044642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.060608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:05.067368 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:05.075872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:05.076780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:05.077557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:05.078144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:05.078922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:05.079682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 248/485] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:05.087532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 238/486] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:05.089312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:05.092638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:05.252790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de2dc-73bc-4689-b379-cb8f938f02b7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:05.296076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.297112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.297881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.298369 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.299317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:05.299838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:05.301537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:05.304325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:05.312122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 249/487] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:05.318101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:05.334377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97c893-9ab2-4ec1-8844-24ccef0a8791 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:05.401949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.402635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.402927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.403438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.403975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:05.404315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:05.405709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:05.423834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 239/488] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:05.430172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64473df-e7b0-4e3d-8d96-8edc09a039c8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:05.440501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:05.468793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d9506-2fc3-4601-9aa9-b86e33150b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.469968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d9506-2fc3-4601-9aa9-b86e33150b88 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.470445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d9506-2fc3-4601-9aa9-b86e33150b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.471009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d9506-2fc3-4601-9aa9-b86e33150b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.483192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d9506-2fc3-4601-9aa9-b86e33150b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:05.485053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d9506-2fc3-4601-9aa9-b86e33150b88 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:05.495591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-641d9506-2fc3-4601-9aa9-b86e33150b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:05.506717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:05.507707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:05.508965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:05.508965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:05.508965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:05.508965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:05.511540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 250/489] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:05.518774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950feb04-1cc1-4276-897d-7a10963abb62 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.519613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950feb04-1cc1-4276-897d-7a10963abb62 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.520264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950feb04-1cc1-4276-897d-7a10963abb62 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.522143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 251/490] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:05.524176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950feb04-1cc1-4276-897d-7a10963abb62 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:05.582877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:05.584479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c2394-bdef-411c-8d13-04398cce5905 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:05.627809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735824e-5fb1-4fde-a851-c52454076dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.628665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735824e-5fb1-4fde-a851-c52454076dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.628957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735824e-5fb1-4fde-a851-c52454076dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.632046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735824e-5fb1-4fde-a851-c52454076dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.646912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735824e-5fb1-4fde-a851-c52454076dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:05.648418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735824e-5fb1-4fde-a851-c52454076dc2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:05.659108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950feb04-1cc1-4276-897d-7a10963abb62 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6735824e-5fb1-4fde-a851-c52454076dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:05.671210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:05.672173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:05.672995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:05.672995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:05.672995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:05.672995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:05.672995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 240/491] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:05.674243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad9b7-befb-49b8-b263-d72dd4ca3e55 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.674538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad9b7-befb-49b8-b263-d72dd4ca3e55 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.674821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad9b7-befb-49b8-b263-d72dd4ca3e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.694437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-65fad9b7-befb-49b8-b263-d72dd4ca3e55 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:05.696086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65fad9b7-befb-49b8-b263-d72dd4ca3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:05.713689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.714479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.714770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.715054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.716134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:05.716452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:05.718251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:05.735843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 252/492] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:05.737062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:05.777561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 241/493] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:05.779199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7711b-db75-43b6-bbc6-dadf89be8537 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.779496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7711b-db75-43b6-bbc6-dadf89be8537 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.779777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7711b-db75-43b6-bbc6-dadf89be8537 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.781375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 242/494] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:05.782093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7711b-db75-43b6-bbc6-dadf89be8537 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:05.793916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:05.858393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f194e-768b-4ba3-9f18-b739f62ea600 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:05.869420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:05.903700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fa336-568d-4102-ad63-508f0787c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.904420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fa336-568d-4102-ad63-508f0787c48e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.904708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fa336-568d-4102-ad63-508f0787c48e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.904992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fa336-568d-4102-ad63-508f0787c48e None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.905735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fa336-568d-4102-ad63-508f0787c48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:05.905878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7711b-db75-43b6-bbc6-dadf89be8537 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:05.906038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fa336-568d-4102-ad63-508f0787c48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:05.907418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fa336-568d-4102-ad63-508f0787c48e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:05.924493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 253/495] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:05.924493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878b25-4eda-4a83-a969-b5f289cd9bc7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.924493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878b25-4eda-4a83-a969-b5f289cd9bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.924493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878b25-4eda-4a83-a969-b5f289cd9bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.938876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-16878b25-4eda-4a83-a969-b5f289cd9bc7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:05.940092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-16878b25-4eda-4a83-a969-b5f289cd9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:05.950899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:05.951705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:05.951995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:05.952295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] PATH_INFO: `/v3/users/glance` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:05.961746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:05.963350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:05.981605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:05.982575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:05.983488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 243/496] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:05.984123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.024661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 254/497] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:06.025559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16878b25-4eda-4a83-a969-b5f289cd9bc7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.073441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.124400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a694-6605-4038-ba86-9098dd84baca None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.137101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.142518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16878b25-4eda-4a83-a969-b5f289cd9bc7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.167291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.168135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.168452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.168732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.179212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:06.184708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.185533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.185805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.186080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:06.188372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:06.189265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:06.190030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 244/498] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:06.190684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.195627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:06.198121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:06.221394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:06.222538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:06.223446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 255/499] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:06.224811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.308918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb355d-61cf-4cbf-a4a9-06ce29804542 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.335747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.341275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855ad7f-f4d1-42af-be84-32a521ce2179 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.346392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd0c17-82e5-4c7e-90fe-48b8d040ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.347074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0c17-82e5-4c7e-90fe-48b8d040ceb5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.347357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0c17-82e5-4c7e-90fe-48b8d040ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.347634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0c17-82e5-4c7e-90fe-48b8d040ceb5 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.348529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd0c17-82e5-4c7e-90fe-48b8d040ceb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:06.348843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd0c17-82e5-4c7e-90fe-48b8d040ceb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:06.350312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd0c17-82e5-4c7e-90fe-48b8d040ceb5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:06.383044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.383838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.384151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.384429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.391765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 245/500] 10.222.0.69 () {56 vars in 1137 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:06.393122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f160b-cc67-4d99-8cd9-3f186faced56 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.393416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f160b-cc67-4d99-8cd9-3f186faced56 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.393704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f160b-cc67-4d99-8cd9-3f186faced56 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.395057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:06.395164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 246/501] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:06.397108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f160b-cc67-4d99-8cd9-3f186faced56 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:06.403278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:06.404821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 256/502] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:06.405794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.426709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.509701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f160b-cc67-4d99-8cd9-3f186faced56 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.521888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddeda0-818e-46f2-8d73-0b0d015ffaa8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.545456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.546122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.546409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.546689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.547437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:06.547748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:06.549186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:06.556299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51976c3-a72e-4c5b-bfdc-9dff7eeab8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.556971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51976c3-a72e-4c5b-bfdc-9dff7eeab8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.557263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51976c3-a72e-4c5b-bfdc-9dff7eeab8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.557373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 247/503] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:06.557536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51976c3-a72e-4c5b-bfdc-9dff7eeab8e5 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.558076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.558453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51976c3-a72e-4c5b-bfdc-9dff7eeab8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:06.558692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51976c3-a72e-4c5b-bfdc-9dff7eeab8e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:06.560153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51976c3-a72e-4c5b-bfdc-9dff7eeab8e5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:06.597266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 257/504] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:06.598774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d307c0-278f-41e1-abc9-2617b767fd5f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.599065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d307c0-278f-41e1-abc9-2617b767fd5f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.599345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d307c0-278f-41e1-abc9-2617b767fd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.613687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.616422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-15d307c0-278f-41e1-abc9-2617b767fd5f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:06.617880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-15d307c0-278f-41e1-abc9-2617b767fd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:06.666763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66d8d0-40d1-4f31-94e1-e70ed7fe437b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.686109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 258/505] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:06.687485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d307c0-278f-41e1-abc9-2617b767fd5f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.700185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.700846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.701135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.701417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.704527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.780008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:06.781520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:06.803486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d307c0-278f-41e1-abc9-2617b767fd5f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.831830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.838270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.838949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.839233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.839509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:06.840301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:06.840621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:06.842009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:06.850086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 259/506] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:06.850816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.889170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 248/507] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:06.890006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:06.926409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:06.960366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea202-a911-4d53-bf35-66270f557c4f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.990272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf9bea-9b28-4ec1-a7e9-4fb195c3a5b3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:06.996319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:06.997200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:06.997550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:06.997886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.010080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.011546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:07.030932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:07.032003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:07.032905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:07.032905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:07.032905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.032905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:07.033377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 260/508] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:07.033979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.034417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.035158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.035547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.035994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.064318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.130190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.133328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.151735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bed8e0-76c7-4d58-86b2-b24d4b1807a7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.175046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.193798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.194733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.195637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.196157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.207815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.209310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:07.229619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:07.230692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:07.236766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:07.236766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:07.236766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.236766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:07.236766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 261/509] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:07.236766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.274999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 249/510] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:07.274999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.322392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.345424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eef5c8-80c9-4a40-bcf1-3808a4ab8f4d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.374195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f53f9c-35ce-4767-8de6-d75e8d906fcf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.380167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.381010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.381235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.381507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.393856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.395299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.409030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.409825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.410109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.410385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:07.415055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:07.415904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:07.416764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:07.416764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:07.416764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.416764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:07.416764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 262/511] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:07.417375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.422074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.423542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:07.441624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:07.442555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:07.443396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:07.443396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:07.443396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.443396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:07.443396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 250/512] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:07.443651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.443972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.522828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbef80b-e70f-46ef-951a-e76929097f02 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.546254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.549241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8972-dee6-4bc1-a953-a8f18a7fea1b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.563495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.564194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.564486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.564771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.565500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:07.565810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.567197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.579761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 263/513] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:07.580599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.589356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.589995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.590189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.590465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.591314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:07.591502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.592909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.604501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 251/514] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:07.605302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.674068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.690244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ec639-35bc-43c4-bc00-d0264843a38d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.710493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a967b-4fc9-446f-a278-1bbe0ab59ccc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.724960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.725764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.726046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.726355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.736835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.738292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.744735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.745395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.745681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.745965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.746721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:07.747030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.750921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:07.755071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:07.755875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:07.756755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:07.756755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:07.756755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:07.756755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:07.756755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 264/515] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:07.758281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.764119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 252/516] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:07.764961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.789771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.869346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93316-88af-499a-b18c-796357308eaf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.871366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8041ed-d03d-4384-a6db-3223b065363d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:07.904418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.905085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.905376 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.905653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.906218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:07.906377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:07.906685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.907032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:07.907313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:07.907588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:07.908098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.910397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:07.915410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:07.916887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:07.920874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 265/517] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:07.921679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:07.934079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:07.934978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 253/518] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:07.936333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.017991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:08.027926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a833-dc66-4a20-9966-fc5f243da81d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.038529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103d8f4-c373-47dc-860d-f54a4a9297db None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.062956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.063629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.063914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.064221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.064933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.066467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.074108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.074781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.075066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.075346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.076113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:08.076426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.077881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.087995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 266/519] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:47:07 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:08.089009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.095053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 254/520] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:08.095053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.163322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:08.220751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ccbbc-7500-471f-a02b-fa119679cbcc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.240267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ef7a-c1dc-4d4e-8ff9-6d693523d3fd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.263508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.264376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.264669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.264953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.273219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.274718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.277876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:08.292299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:08.293237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 255/521] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:08.294593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.301942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.303145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.303543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.303932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.314632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.316123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:08.333180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:08.334100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:08.334978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 267/522] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:08.335556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.415588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f50f-1406-41c4-be0b-5dff0ed15897 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.454854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.455535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.455821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.456154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.456999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:08.457314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.458749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.482632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 256/523] 10.222.0.69 () {56 vars in 1137 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:08.482632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.509226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a15e2-e686-4896-ae0d-523b767b746b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.535860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:08.549755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:08.566642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.567446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.567730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.568007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.575929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.577452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:08.593857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:08.594930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:08.595825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 268/524] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:08.596443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.605415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac4f6-a345-4683-ab5a-d6118ebd1899 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.641831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.642502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.642817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.643095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.643893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:08.644236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.645683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.664618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 257/525] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:08.665464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.720656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a129fc6-5b4b-49f1-8060-31a1bf645836 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.770456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.771142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.771430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.772003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.772900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:08.773260 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.774740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.786850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e08466-80d3-498e-ba91-85ef17686789 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.794511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 269/526] 10.222.0.69 () {56 vars in 1139 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:08.795198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:08.812475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:08.828333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:08.835259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.835962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.836296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.836631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.905159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012f95-8f14-4128-984e-5d5d9d70e7fa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:08.913079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.914520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.945834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:08.946498 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:08.946780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:08.947132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:08.947980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:08.948347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:08.949786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:08.968443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 270/527] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:08.969542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:09.036938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 258/528] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:09.038062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:09.057614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:09.085529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:09.097276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daaca4-e650-44d6-ab4d-9efdfe04527b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:09.134790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:09.135560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:09.136098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:09.136253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:09.137195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=44ef983c46894dc6bff7fff34cc4e50e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:09.137516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:09.138957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:09.144628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 271/529] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:08 2022] GET /identity/v3/role_assignments?user.id=44ef983c46894dc6bff7fff34cc4e50e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:09.148940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f635b-a7bd-4654-88ff-6d753d020232 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:09.149622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:09.192960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:09.193637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:09.193926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:09.194204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:09.284689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:09.286240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:09.296796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051608-f693-4d87-a8c8-e3163c13d5c9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:09.310103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:09.343336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:09.344385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:09.345358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:09.345800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:09.347076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=9e36af3331a04e13b05fcbb8b2d9cd1e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:09.347401 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:09.349446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:09.360108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 272/530] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:09 2022] GET /identity/v3/role_assignments?user.id=9e36af3331a04e13b05fcbb8b2d9cd1e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:09.362690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:09.417010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:09.465646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 259/531] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:09.469699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:09.582794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cd355-b08d-4a38-bf5e-50ed20c8b53b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:09.607915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6998-c2af-4ebb-bf18-40b3ecd81fb1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:09.629145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:09.649081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:09.650072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:09.650361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:09.650640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:09.652865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:09.653888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:09.654373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:09.654856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:09.664102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:09.666338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:09.667345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:09.669990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:09.689310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:09.690754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:09.691892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:09.691892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:09.691892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:09.691892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:09.691892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 273/532] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:09.701764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:09.703361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:09.704934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:09.706595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:09.706595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:09.706595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:09.706595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:09.706595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 260/533] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:09.714869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:09.790023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:09.838466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388cbad-d3e1-4bea-a7f4-f3858801a884 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:09.905308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:09.906548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:09.907044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:09.907520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:09.908490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:09.909425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:09.911001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:09.925670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 274/534] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:09.931789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:10.016262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043059a-7599-4ab2-b993-376476d08476 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:10.048335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791b439-8b4a-4952-bc81-7b6669d99e51 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:10.067168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:10.067841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.068158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.068444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.069179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:10.069486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:10.071433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:10.082955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:10.092120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 261/535] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:10.092120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:10.098102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:10.099272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.099758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.100258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.111176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:10.120050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:10.121390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:10.140489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:10.141375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:10.142273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 275/536] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:10.152991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:10.194465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a218-baea-42d4-9a8a-e12afc738996 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:10.231989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:10.232828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.233121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.233403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.250651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:10.252138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:10.276790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:10.277687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:10.278515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 262/537] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:10.289753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:10.327193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1855ad-5365-4a49-8091-b462549d55b8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:10.363037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:10.364085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.364601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.365075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.366214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:10.367251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:10.369001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:10.383735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 276/538] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:10.391422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:10.472412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:10.510029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e80981-7017-4832-b2d3-719d6dedfc4c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:10.551580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a785-f466-47cc-be47-8c1489d48e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:10.552693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a785-f466-47cc-be47-8c1489d48e2f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.553233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a785-f466-47cc-be47-8c1489d48e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.554645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a785-f466-47cc-be47-8c1489d48e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.555948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a785-f466-47cc-be47-8c1489d48e2f None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=0d8e2195d53743f78c58cebdcd850fb5) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:10.556494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a785-f466-47cc-be47-8c1489d48e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:10.558302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a785-f466-47cc-be47-8c1489d48e2f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:10.565264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 277/539] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:10 2022] GET /identity/v3/role_assignments?user.id=0d8e2195d53743f78c58cebdcd850fb5&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:10.596066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18d08-bbe5-4b70-9039-3a82a6ff8f1b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.596709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18d08-bbe5-4b70-9039-3a82a6ff8f1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.597191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18d08-bbe5-4b70-9039-3a82a6ff8f1b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.599314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:10.599554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 278/540] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:47:10.606041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d78aa-68cb-4cbe-a02f-fcbe4a592a56 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.606687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d78aa-68cb-4cbe-a02f-fcbe4a592a56 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.607166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d78aa-68cb-4cbe-a02f-fcbe4a592a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.626339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1b156-34a2-4c35-8ccd-e4c6da3cd051 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:10.628973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cd3d78aa-68cb-4cbe-a02f-fcbe4a592a56 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:10.630416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd3d78aa-68cb-4cbe-a02f-fcbe4a592a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:10.717321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 279/541] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:47:10.736582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:10.737623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.738154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.738631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.739639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:10.740215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:10.742468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:10.763146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 263/542] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:10.768694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d78aa-68cb-4cbe-a02f-fcbe4a592a56 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:10.780286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:10.880437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:10.922616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b680a-7e21-4ce7-b6d5-70d06078ed7f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:10.968038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:10.968038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:10.968038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:10.968038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:10.977453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:10.986467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:10.987359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:10.988183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 264/543] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:10.996913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:11.010160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d78aa-68cb-4cbe-a02f-fcbe4a592a56 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:11.021787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:11.061940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:11.063024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:11.063510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:11.063987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:11.065082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=eadb39271321475ebb10382db43db0b3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:11.065626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:11.067457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:11.077850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 280/544] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:10 2022] GET /identity/v3/role_assignments?user.id=eadb39271321475ebb10382db43db0b3&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:11.134195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6246ae-1b50-4c41-802a-27093b68b391 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:11.173935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:11.174615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:11.174901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:11.175180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:11.175961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:11.176312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:11.177819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:11.188071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 265/545] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:11.193552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:11.319114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dbf43-4d75-4023-a001-8d3cef714046 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:11.330081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:11.360687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:11.361502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:11.361792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:11.362070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:11.373752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:11.375235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:11.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:11.394229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:11.395059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:11.395059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:11.395059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:11.395059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:11.395059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 281/546] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:11.401379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:11.478816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:11.524790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac628e-1729-4ed7-9a46-92bd94be1deb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:11.584942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:11.585826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:11.586192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:11.586402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:11.587177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:11.587494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:11.588978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:11.602806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 266/547] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:11.608262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:11.717464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451889-80a2-4467-9f3d-be105ed211d6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:11.760295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d87b5-7345-430c-a3ec-6bfccaadcaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:11.761118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d87b5-7345-430c-a3ec-6bfccaadcaae None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:11.761428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d87b5-7345-430c-a3ec-6bfccaadcaae None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:11.764048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d87b5-7345-430c-a3ec-6bfccaadcaae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:11.773720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d87b5-7345-430c-a3ec-6bfccaadcaae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:11.775250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d87b5-7345-430c-a3ec-6bfccaadcaae None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b78d87b5-7345-430c-a3ec-6bfccaadcaae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:11.797896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:11.799517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:11.800806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 282/548] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:11.804827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:11.862766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea995-e91f-496a-a8c1-5bd575636024 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:11.863100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea995-e91f-496a-a8c1-5bd575636024 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:11.863329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ea995-e91f-496a-a8c1-5bd575636024 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:11.864729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 283/549] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:11.870452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116f95-aeee-4832-9da0-c3fc9a497e77 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:11.870742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116f95-aeee-4832-9da0-c3fc9a497e77 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:11.871020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116f95-aeee-4832-9da0-c3fc9a497e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:11.906310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e8116f95-aeee-4832-9da0-c3fc9a497e77 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:11.910207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e8116f95-aeee-4832-9da0-c3fc9a497e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:11.939411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:11.965927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45fc2f-9175-4862-8c2b-57d0733fc651 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.004367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:12.009796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.010634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.010910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.011191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.012183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:12.012486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:12.013957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:12.047947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 284/550] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:47:12.054650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 267/551] 10.222.0.69 () {56 vars in 1135 bytes} [Thu May 26 17:47:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:12.060341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8116f95-aeee-4832-9da0-c3fc9a497e77 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.100157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.200254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8116f95-aeee-4832-9da0-c3fc9a497e77 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.217226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6365d-af97-4a3b-ad0b-33104d19a2ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.239203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f1a59-e7f5-4c21-9f3b-4d27aa0fdb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.239858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f1a59-e7f5-4c21-9f3b-4d27aa0fdb12 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.240189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f1a59-e7f5-4c21-9f3b-4d27aa0fdb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.240467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f1a59-e7f5-4c21-9f3b-4d27aa0fdb12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.254508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42554709-8110-4410-8321-af39b1f30a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.255234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554709-8110-4410-8321-af39b1f30a63 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.255524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554709-8110-4410-8321-af39b1f30a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.255800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554709-8110-4410-8321-af39b1f30a63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.261953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:12.271686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42554709-8110-4410-8321-af39b1f30a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-42554709-8110-4410-8321-af39b1f30a63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:12.280955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:12.282165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:12.283198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:12.285564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 268/552] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:12.287040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacb843-6b83-4048-b3a2-21a46c471a1c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.287480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacb843-6b83-4048-b3a2-21a46c471a1c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.287909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacb843-6b83-4048-b3a2-21a46c471a1c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.293651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 269/553] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:12.294556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacb843-6b83-4048-b3a2-21a46c471a1c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.315344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f1a59-e7f5-4c21-9f3b-4d27aa0fdb12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:12.316774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f1a59-e7f5-4c21-9f3b-4d27aa0fdb12 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:12.351852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:12.409374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacb843-6b83-4048-b3a2-21a46c471a1c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.425646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 285/554] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:47:12.427264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706090cd-5576-4887-8453-ae4e9ea7e5ba None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.427565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706090cd-5576-4887-8453-ae4e9ea7e5ba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.427866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706090cd-5576-4887-8453-ae4e9ea7e5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.445495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-706090cd-5576-4887-8453-ae4e9ea7e5ba None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:12.447122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-706090cd-5576-4887-8453-ae4e9ea7e5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:12.450360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.451328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.451828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.452428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.453380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:12.453963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:12.455770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:12.466078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 270/555] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:12.467259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.498002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:12.528119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 286/556] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:12.528119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706090cd-5576-4887-8453-ae4e9ea7e5ba None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.597427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1926c9f-1566-4bc2-a24e-b9431d6f4043 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.621905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:12.653031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.654092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.654380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.655072 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.657661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706090cd-5576-4887-8453-ae4e9ea7e5ba None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.670664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:12.672453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:12.696817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:12.697761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:12.698621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:12.698621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:12.698621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:12.698621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:12.698621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 271/557] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:12.699262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.700104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.701129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.701610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.706381 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.718571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:12.720347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:12.739085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:12.740544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:12.741441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:12.741441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:12.741441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:12.741441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:12.743961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 287/558] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:12.745009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.810515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:12.813884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d60a-6682-4128-8112-e8f24fb1d8e0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.852561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.853417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.853713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.853996 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.864686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:12.872963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:12.873888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:12.874751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 272/559] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:12.875521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.903572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:12.907853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cbdab-81ea-4ab9-a0d2-a52b3e017897 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:12.956273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:12.956948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:12.957236 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:12.957516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:12.958253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:12.958562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:12.959945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:12.979065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 288/560] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:12.980571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:12.997160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467738-0f75-4f2b-a372-dfc08757e9b5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.034746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.035424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.035720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.036074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.036815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:13.037139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.039039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.056312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 273/561] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:13.056312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.118743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:13.131267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341f71-8bd6-4529-9dcb-d2dd8d42f174 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.159949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:13.169592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.170516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.170953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.171331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.172337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:13.172751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.174217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.183275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90807de-4886-4b74-a0c4-73eb5034ea1b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.184753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 289/562] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:13.185898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.228912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.230289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.231005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.231396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.241116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.243226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:13.262755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:13.263738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:13.264801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 274/563] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:13.266229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.310963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2f92-4beb-4518-ade5-15c34cd693d9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.346521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.347333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.347619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.347895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.356332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.357776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:13.372152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:13.373112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 290/564] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:13.374671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.392374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294779-ff1c-4565-acc2-50083302d577 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.392833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:13.432180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0035e6-f43b-409d-b594-b8f77417e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.432980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0035e6-f43b-409d-b594-b8f77417e4ca None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.433264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0035e6-f43b-409d-b594-b8f77417e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.433543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0035e6-f43b-409d-b594-b8f77417e4ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.444689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0035e6-f43b-409d-b594-b8f77417e4ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.446232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0035e6-f43b-409d-b594-b8f77417e4ca None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.449595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6c0035e6-f43b-409d-b594-b8f77417e4ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:13.465956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:13.466874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:13.467833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:13.467833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:13.467833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:13.467833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:13.467833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 275/565] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:13.469108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e596ae0-5c27-40c0-a1fc-51d0526aa9a0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.469108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e596ae0-5c27-40c0-a1fc-51d0526aa9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.469108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e596ae0-5c27-40c0-a1fc-51d0526aa9a0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.470403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 276/566] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:13.470950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e596ae0-5c27-40c0-a1fc-51d0526aa9a0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.493281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea624e98-fe78-4bc2-9a1d-d80265ccc288 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.535118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.536146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.536618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.536907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.537712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:13.538029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.540486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.553717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 291/567] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:13.554614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.597046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e596ae0-5c27-40c0-a1fc-51d0526aa9a0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.633730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca108d-0bba-4dc8-a495-70ace498bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.634326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca108d-0bba-4dc8-a495-70ace498bc7a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.634612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca108d-0bba-4dc8-a495-70ace498bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.634895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca108d-0bba-4dc8-a495-70ace498bc7a None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.635732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca108d-0bba-4dc8-a495-70ace498bc7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:13.636064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca108d-0bba-4dc8-a495-70ace498bc7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.637587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca108d-0bba-4dc8-a495-70ace498bc7a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.645952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:13.657850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 277/568] 10.222.0.69 () {56 vars in 1137 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:13.659389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecfe22-0ff4-4f77-879c-5bcfea2abc97 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.659892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecfe22-0ff4-4f77-879c-5bcfea2abc97 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.660366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecfe22-0ff4-4f77-879c-5bcfea2abc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.677495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-22ecfe22-0ff4-4f77-879c-5bcfea2abc97 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:13.678677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-22ecfe22-0ff4-4f77-879c-5bcfea2abc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:13.679923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7ef5e-cde9-4f49-b76a-7838e8f75721 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.715484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.716190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.716477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.716756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.717487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:13.717799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.719162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.730209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:13.730879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 292/569] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:13.731635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.748503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 278/570] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:13.749663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecfe22-0ff4-4f77-879c-5bcfea2abc97 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.844132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06bc86-fb67-4026-a9cf-4e5e7c6fd92a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.854508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecfe22-0ff4-4f77-879c-5bcfea2abc97 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:13.878981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e846072-cac4-4699-ab2a-186f4be9e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.879637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846072-cac4-4699-ab2a-186f4be9e82e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.879921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846072-cac4-4699-ab2a-186f4be9e82e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.880230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e846072-cac4-4699-ab2a-186f4be9e82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.881060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e846072-cac4-4699-ab2a-186f4be9e82e None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=0dc7da9d33b941dc91a98c8adbb545d9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:13.881374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e846072-cac4-4699-ab2a-186f4be9e82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.883130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e846072-cac4-4699-ab2a-186f4be9e82e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.885009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:13.889720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:13.890507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.890787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.891058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.892308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 293/571] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/role_assignments?user.id=0dc7da9d33b941dc91a98c8adbb545d9&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:13.893636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acb486-efa4-43de-8693-b6d4c384e111 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:13.893934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acb486-efa4-43de-8693-b6d4c384e111 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:13.894215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acb486-efa4-43de-8693-b6d4c384e111 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:13.895724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 294/572] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:13.896612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acb486-efa4-43de-8693-b6d4c384e111 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.908081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:13.909571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:13.931207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:13.932226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:13.933214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:13.933214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:13.933214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:13.933214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:13.933214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 279/573] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:13.933485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:13.975906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.015647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acb486-efa4-43de-8693-b6d4c384e111 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.053320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247e8ba-9cf1-4ed1-8490-860e46800cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.054104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2c2db-4cfa-48e0-b497-8d5207226dfe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.054243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247e8ba-9cf1-4ed1-8490-860e46800cea None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.054509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247e8ba-9cf1-4ed1-8490-860e46800cea None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.054724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247e8ba-9cf1-4ed1-8490-860e46800cea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.062932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247e8ba-9cf1-4ed1-8490-860e46800cea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.064419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247e8ba-9cf1-4ed1-8490-860e46800cea None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d247e8ba-9cf1-4ed1-8490-860e46800cea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:14.080074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:14.081044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:14.081964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 295/574] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:14.082610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdfbe-4a62-42f7-be39-584aae58b183 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.083282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdfbe-4a62-42f7-be39-584aae58b183 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.083282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdfbe-4a62-42f7-be39-584aae58b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.100553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-110bdfbe-4a62-42f7-be39-584aae58b183 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:14.102352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.102883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-110bdfbe-4a62-42f7-be39-584aae58b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:14.103158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.103445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.103721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.115690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:14.123513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:14.124485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:14.125302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 280/575] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:14.126985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.166081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.186167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 296/576] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:14.186167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bdfbe-4a62-42f7-be39-584aae58b183 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.237814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.245381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575405-143a-4286-81d5-85e045f59a99 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.281083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.281748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.282033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.282315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.283034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:14.283341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.284785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.299784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 281/577] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:14.300902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.309404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bdfbe-4a62-42f7-be39-584aae58b183 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.346256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223406-712f-465f-a90a-17197454aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.346955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223406-712f-465f-a90a-17197454aacb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.347243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223406-712f-465f-a90a-17197454aacb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.347520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223406-712f-465f-a90a-17197454aacb None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.348402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223406-712f-465f-a90a-17197454aacb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:14.348715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223406-712f-465f-a90a-17197454aacb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.350147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223406-712f-465f-a90a-17197454aacb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.372215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 297/578] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:14.372215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223406-712f-465f-a90a-17197454aacb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.418020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.423473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1d68-4630-471f-9ec6-18ec50ab4807 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.469720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.470602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.470934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.471311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.472320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:14.472930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.474382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.475491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223406-712f-465f-a90a-17197454aacb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.484147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 282/579] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:14.489959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.512001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.513211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.514135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.514543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.514912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.527537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:14.535254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:14.536237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 298/580] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:14.542451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.612094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec35397-323e-4d60-a57e-cc4f9d677b36 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.647046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5c650-c67b-4ca9-b839-0141ac050d84 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.650609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.651405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.651688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.651966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.655826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.659188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.660679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:14.675679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:14.676837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:14.677827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 283/581] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:14.678323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.693114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.693851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.694141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.695186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.706143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.707608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:14.726758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:14.727715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:14.728631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:14.728631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:14.728631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:14.728631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:14.728631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 299/582] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:14.728922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.776845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.801123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74978-2052-48c4-b5b8-16206be776a9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.837875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce0882-1e75-4469-8722-456340c368fc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:14.840548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.841354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.841644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.841926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.852798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.854369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:14.873641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:14.874514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:14.875378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:14.875378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:14.875378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:14.875378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:14.877314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 284/583] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:14.878372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.879893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:14.880698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:14.881057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:14.881526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:14.883162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:14.883464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:14.884870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:14.898293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 300/584] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:14.898293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:14.921160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:14.994285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f93ce-5537-412b-8b3f-801d5ccae3ea None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.010467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda17b78-bca5-4c14-be5f-42466c1f89f0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.028213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:15.035953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.036865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.037352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.037908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.038751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:15.039237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.040851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.046622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.047290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.047575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.048359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.049102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:15.049414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.050770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.053369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 285/585] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:15.055110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.068269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 301/586] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:15.069169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.151156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:15.168560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b70d4-5ea4-40c1-92c0-e9e72992f900 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.172095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d0fe8-244e-48da-a75c-302834e0fa4b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.203931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.204631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.204920 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.205203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.205931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:15.206306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.207634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.207748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.208543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.208831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.209113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.219237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.220701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.225474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 286/587] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:15.226860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:15.240270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:15.241184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:15.242803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:15.242803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:15.242803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:15.242803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:15.242803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 302/588] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:15.243076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.284901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:15.341051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe761-5cb2-4cb1-8412-e29fd1cf16a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.347442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae325d72-230c-457d-8753-8c43a34016ba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.377750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.378640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.378927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.379205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/44ef983c46894dc6bff7fff34cc4e50e/roles/3f20b0bae044417383cdf3692e11bed6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.379767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:15.386261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.387059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.387340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.387673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.396683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.397317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=44ef983c46894dc6bff7fff34cc4e50e, role_id=3f20b0bae044417383cdf3692e11bed6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.398715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.398940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.419828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 287/589] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:15 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/44ef983c46894dc6bff7fff34cc4e50e/roles/3f20b0bae044417383cdf3692e11bed6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:15.420074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:15.420887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:15.421847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:15.422282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.422353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 303/590] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:15.422353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.549336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:15.550123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07fde-fb90-4e55-af07-bd57bb21e10d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.554398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323c053-8287-4488-baeb-dcc91fef3ee6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.596987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.597760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.598115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.598458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.599267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:15.599646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.602202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.602801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.603163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.603506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.603848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.616206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.618394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.619257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 304/591] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:15.620397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:15.641946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:15.642953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:15.643917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 288/592] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:15.644650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.686030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:15.752126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f462bc-20f1-4488-be1c-e54a454b3934 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.767718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f36f2-7a0f-430f-a15d-83fe0a5cdf1d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.805818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.806687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.806979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.807673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.808776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:15.809098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.810835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.812570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:15.813675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:15.814123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:15.814554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:15.823867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:15.825551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:15.825836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 305/593] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:15.826892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:15.843887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:15.845050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:47:15.845964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:15.848667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 289/594] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:15.849707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:15.874975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:15.968980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca37421-96fa-41d5-a3c1-c75ca3fa6ffe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.971307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c425-22df-4ad9-a9e6-aaad7d910734 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:15.986135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:16.011108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.012294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.012829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.013299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.014361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:16.014867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.016542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.017678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.018760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.019054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.019335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/9e36af3331a04e13b05fcbb8b2d9cd1e/roles/3f20b0bae044417383cdf3692e11bed6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.036922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 306/595] 10.222.0.69 () {56 vars in 1137 bytes} [Thu May 26 17:47:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:16.037785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.044229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=9e36af3331a04e13b05fcbb8b2d9cd1e, role_id=3f20b0bae044417383cdf3692e11bed6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.045982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.068763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 290/596] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:15 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/9e36af3331a04e13b05fcbb8b2d9cd1e/roles/3f20b0bae044417383cdf3692e11bed6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:16.069357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.175101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:16.197761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bda72-f952-4378-9e2b-1830719ffe43 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:16.221657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225d591-0f0e-4217-91fd-d5ab3b898766 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:16.243010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f77d-76df-4046-836d-2736c0db45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.243883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f77d-76df-4046-836d-2736c0db45f1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.244280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f77d-76df-4046-836d-2736c0db45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.244651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f77d-76df-4046-836d-2736c0db45f1 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.245657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f77d-76df-4046-836d-2736c0db45f1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:16.246013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f77d-76df-4046-836d-2736c0db45f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.247571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f77d-76df-4046-836d-2736c0db45f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.274705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 307/597] 10.222.0.69 () {56 vars in 1139 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:16.276820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f6c9-dcb1-4176-bcbf-b987291d1441 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.277370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f6c9-dcb1-4176-bcbf-b987291d1441 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.277755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f6c9-dcb1-4176-bcbf-b987291d1441 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.278619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb7da-931a-4100-aec3-33ba2a98c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.279330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 308/598] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:16.279499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb7da-931a-4100-aec3-33ba2a98c185 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.279777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb7da-931a-4100-aec3-33ba2a98c185 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.279878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677f6c9-dcb1-4176-bcbf-b987291d1441 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.280084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb7da-931a-4100-aec3-33ba2a98c185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.298961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75feb7da-931a-4100-aec3-33ba2a98c185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.300878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75feb7da-931a-4100-aec3-33ba2a98c185 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.319273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-75feb7da-931a-4100-aec3-33ba2a98c185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:16.321448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:16.322345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:16.323245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:16.323245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:16.323245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:16.323245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:16.323245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 291/599] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:16.324479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021471-910c-4abb-ab91-61fd87eadb43 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.324765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021471-910c-4abb-ab91-61fd87eadb43 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.325167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021471-910c-4abb-ab91-61fd87eadb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.347016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-75021471-910c-4abb-ab91-61fd87eadb43 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:16.348831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-75021471-910c-4abb-ab91-61fd87eadb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:16.413774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677f6c9-dcb1-4176-bcbf-b987291d1441 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:16.446001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 292/600] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:16.453446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75021471-910c-4abb-ab91-61fd87eadb43 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.461556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.463213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.463977 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.464651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.480691 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:16.501014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:16.501961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:16.502837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:16.502837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:16.502837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:16.502837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:16.505353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 309/601] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:16.511096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.541809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:16.607387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75021471-910c-4abb-ab91-61fd87eadb43 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:16.614424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:16.643550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09a9a-42c8-4e8a-bf49-9d89e2e3deba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:16.652697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.653691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.654195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.654684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.655615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:16.656196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.657788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.671197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 293/602] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:16.672525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.685637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.686132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.686425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.686706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.687453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:16.687765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.689380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.703747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 310/603] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:16.704831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.781168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bb05-13cd-4949-87de-9de6a6cd9a85 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:16.795537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:16.818828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.820043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.820537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.821042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.821656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31659dd-8483-4330-b398-8727a98d513d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:16.832871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:16.841674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:16.842601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:16.843413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:16.851258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 294/604] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:16.852651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.857915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:16.858533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:16.858830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:16.859111 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:16.868214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:16.869675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:16.872591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:16.885955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:16.886870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:16.887747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 311/605] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:16.888698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:16.976919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7569b-8f1d-488e-9d78-15738fca93e5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.005464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9c0d4-fa2c-4eea-afd4-c3c293ed5c31 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.013496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.014642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.015632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.024152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.026134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:17.042935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:17.043810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:17.044740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:17.045150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.045150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.045150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.045150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.045428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:17.045495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.046869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.047837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 295/606] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:17.048910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.060730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 312/607] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:17.060730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.088152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:17.128205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:17.165109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2001e7b-5459-4855-b3e0-7c1a0af0cbf4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.171683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ebebd-cfc9-4e6d-beae-e30fb82436b2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.203850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.205242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.205835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.206312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.207275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:17.207593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.209079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.209518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.210483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.211064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.211544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.212613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:17.213164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.214808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.222030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 296/608] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:17.223047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.229212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 313/609] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:17.230386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.325332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:17.339226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a26a04-b1f1-4008-9777-447d6fd75b85 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.343384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaabed1-d32e-4d75-b812-9b1e802c3d09 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.368771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:17.382283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.383547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.384098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.384583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/0d8e2195d53743f78c58cebdcd850fb5/roles/3f20b0bae044417383cdf3692e11bed6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.385990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.386790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.387073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.387349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.401802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.402373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=0d8e2195d53743f78c58cebdcd850fb5, role_id=3f20b0bae044417383cdf3692e11bed6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.403283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.404288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.422493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 314/610] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:17 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/0d8e2195d53743f78c58cebdcd850fb5/roles/3f20b0bae044417383cdf3692e11bed6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:17.423046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:17.424319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:17.425265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:17.425265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:17.425265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:17.425265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:17.426724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.429899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 297/611] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:17.430920 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.545884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9eb96-ae0d-4d67-af38-4d8bbecd66b7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.552145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8bce1-b844-44c3-bfa8-d2b2d62f1fd0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.583684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.584470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.584758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.585131 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.586094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:17.586410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.587855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.602290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 298/612] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:17.606192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.607589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.607851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.608341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.608825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/eadb39271321475ebb10382db43db0b3/roles/3f20b0bae044417383cdf3692e11bed6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.617755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:17.634339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=eadb39271321475ebb10382db43db0b3, role_id=3f20b0bae044417383cdf3692e11bed6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.636205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.666634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 315/613] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:17 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/eadb39271321475ebb10382db43db0b3/roles/3f20b0bae044417383cdf3692e11bed6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:17.749159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcffc8-1e96-4803-ba36-ba15b3639a3e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:17.795680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce13e5-e1cc-4cff-a0e1-73ee7e549ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:17.797061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce13e5-e1cc-4cff-a0e1-73ee7e549ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:17.797589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce13e5-e1cc-4cff-a0e1-73ee7e549ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:17.798083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce13e5-e1cc-4cff-a0e1-73ee7e549ff5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:17.810858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce13e5-e1cc-4cff-a0e1-73ee7e549ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:17.812879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce13e5-e1cc-4cff-a0e1-73ee7e549ff5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-09ce13e5-e1cc-4cff-a0e1-73ee7e549ff5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:17.841292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:17.842289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:17.843210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:17.845708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 299/614] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:17.852223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:17.888514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:17.987738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7d085-9eaf-456d-a0ff-70cc2c185ff3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.028069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:18.028757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.029046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.029323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.030185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:18.030502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:18.031947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:18.037348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db41d-d411-4290-ab1d-245f9ac1decc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.037638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db41d-d411-4290-ab1d-245f9ac1decc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.037921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db41d-d411-4290-ab1d-245f9ac1decc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.040242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 300/615] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:18.045847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e85a4-9c89-4391-b77c-2750b0111c99 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.046401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e85a4-9c89-4391-b77c-2750b0111c99 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.046892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e85a4-9c89-4391-b77c-2750b0111c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.056432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 316/616] 10.222.0.69 () {56 vars in 1135 bytes} [Thu May 26 17:47:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:18.062638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:18.086836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0f5e85a4-9c89-4391-b77c-2750b0111c99 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:18.088052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f5e85a4-9c89-4391-b77c-2750b0111c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:18.156829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:18.177862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ec99f-b4f4-4ff3-ada3-b0b1cf19b230 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.203112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:18.215598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:18.216438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.216728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.217072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.228031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:18.229632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:18.231856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 301/617] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:18.261253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:18.262186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:18.263041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:18.263041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:18.263041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:18.263041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:18.263041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 317/618] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:18.269224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e85a4-9c89-4391-b77c-2750b0111c99 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:18.275464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:18.408148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd46af-fcd9-442a-9317-254115fb4e8c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.444041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:18.445299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:18.446182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.446472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.446752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.467243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:18.476262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e85a4-9c89-4391-b77c-2750b0111c99 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:18.486375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:18.488284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:18.490011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 318/619] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:18.497104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:18.560731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0a3b5-d8a7-4101-8385-aa2f940b8e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:18.561793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0a3b5-d8a7-4101-8385-aa2f940b8e77 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.562287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0a3b5-d8a7-4101-8385-aa2f940b8e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.562758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0a3b5-d8a7-4101-8385-aa2f940b8e77 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.563742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0a3b5-d8a7-4101-8385-aa2f940b8e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:18.564339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0a3b5-d8a7-4101-8385-aa2f940b8e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:18.566670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0a3b5-d8a7-4101-8385-aa2f940b8e77 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:18.585580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 302/620] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:18.590255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2d93-2b85-4992-bb06-df5088fb8825 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.590255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2d93-2b85-4992-bb06-df5088fb8825 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.590255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2d93-2b85-4992-bb06-df5088fb8825 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.590255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 303/621] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:18.594456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd2d93-2b85-4992-bb06-df5088fb8825 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:18.653485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a6e51-e295-492b-972c-ef979641c2f2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.671182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:18.695274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b25a65-8cbc-41ed-8681-97db76c1f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:18.696371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25a65-8cbc-41ed-8681-97db76c1f21c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.696877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25a65-8cbc-41ed-8681-97db76c1f21c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.697355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25a65-8cbc-41ed-8681-97db76c1f21c None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.698323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b25a65-8cbc-41ed-8681-97db76c1f21c None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:18.698843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b25a65-8cbc-41ed-8681-97db76c1f21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:18.700441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b25a65-8cbc-41ed-8681-97db76c1f21c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:18.709516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 319/622] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:18.711715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5ff21-7c2d-4a3c-a269-433598a7a0dc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.712249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5ff21-7c2d-4a3c-a269-433598a7a0dc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.712744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5ff21-7c2d-4a3c-a269-433598a7a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.730542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d2f5ff21-7c2d-4a3c-a269-433598a7a0dc None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:18.732293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d2f5ff21-7c2d-4a3c-a269-433598a7a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:18.732480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd2d93-2b85-4992-bb06-df5088fb8825 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.781168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:18.782229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:18.782527 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:18.782803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:18.792887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:18.794345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:18.809769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:18.811781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:18.812683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:18.813565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:18.820287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 304/623] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:18.821381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:18.832675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 320/624] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:18.833522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5ff21-7c2d-4a3c-a269-433598a7a0dc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:18.968620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860d221-9b28-48f9-9c4d-5406bf945fbe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.980783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5ff21-7c2d-4a3c-a269-433598a7a0dc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:18.986649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:19.014450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.015667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.015960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.016289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.025191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.026116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.026971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.027732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.028433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:19.028983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:19.029493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:19.029891 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:19.031642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:19.050522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:19.051472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:19.052392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:19.052392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:19.052392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:19.052392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:19.053303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 321/625] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:19.055140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.056941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 305/626] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:19.057764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.114348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:19.176915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352ac5-9b68-4396-9303-768c7f70835d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:19.195974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bc12-a959-4211-9869-1b7c11354837 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:19.226400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.227167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.227558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.227841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.238361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.239266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.239553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.239750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:19.239849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/0dc7da9d33b941dc91a98c8adbb545d9/roles/3f20b0bae044417383cdf3692e11bed6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:19.248053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:19.248962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:19.249787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 322/627] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:19.250939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.258080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=0dc7da9d33b941dc91a98c8adbb545d9, role_id=3f20b0bae044417383cdf3692e11bed6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:19.259549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:19.276353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 306/628] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:19 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/0dc7da9d33b941dc91a98c8adbb545d9/roles/3f20b0bae044417383cdf3692e11bed6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:19.277743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.309205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:19.419860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7364cea-b2ef-463f-bf97-5625e9f9dbb6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:19.463387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.464844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.464844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.464844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.465855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:19.466179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:19.468635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:19.479966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 307/629] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:19.481095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba74a9-903b-4948-b5a0-aa475aa28711 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:19.484766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:19.487511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.524414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.525514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.526018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.526541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.527470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:19.528002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:19.529664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:19.545776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 323/630] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:19.553176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.607709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:19.650772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a8fa-6cd1-4756-87aa-12a7a3ca406d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:19.717724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.718907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.719165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76027c-7412-4c77-ba45-67d084ea27f2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:19.719609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.720136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.743391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:19.745233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:19.768635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:19.769508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:19.769796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:19.770074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:19.774400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:19.775285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:19.776193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:19.776193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:19.776193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:19.776193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:19.778443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 308/631] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:19.785075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.786240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:19.788967 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:19.816659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:19.817662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:19.818602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 324/632] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:19.826439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:19.886918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:19.986967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a413e-83d3-48c4-b791-cc8bdb14ef89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.021434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:20.033767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362eb6e-2214-471a-8747-7536f13560a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.035087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362eb6e-2214-471a-8747-7536f13560a8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.035413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362eb6e-2214-471a-8747-7536f13560a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.035711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362eb6e-2214-471a-8747-7536f13560a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.036667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362eb6e-2214-471a-8747-7536f13560a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:20.037000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362eb6e-2214-471a-8747-7536f13560a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:20.039069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362eb6e-2214-471a-8747-7536f13560a8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:20.053789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 309/633] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:20.059401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6eb99-d14d-4b2c-b764-74678b14afbb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.059702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6eb99-d14d-4b2c-b764-74678b14afbb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.059984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6eb99-d14d-4b2c-b764-74678b14afbb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.061779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 310/634] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:20.063160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6eb99-d14d-4b2c-b764-74678b14afbb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.069540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8ab2-ecd2-414c-9d52-aebd68b4efb3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.107248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc41423-0f17-46eb-b923-1aa49bcc4fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.107929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41423-0f17-46eb-b923-1aa49bcc4fab None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.108302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41423-0f17-46eb-b923-1aa49bcc4fab None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.108572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41423-0f17-46eb-b923-1aa49bcc4fab None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.109425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41423-0f17-46eb-b923-1aa49bcc4fab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:20.109740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41423-0f17-46eb-b923-1aa49bcc4fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:20.111432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41423-0f17-46eb-b923-1aa49bcc4fab None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:20.144112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 325/635] 10.222.0.69 () {56 vars in 1137 bytes} [Thu May 26 17:47:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:20.145448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617781-4e94-4c0b-a1ac-4567ef77ba0d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.145741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617781-4e94-4c0b-a1ac-4567ef77ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.146273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617781-4e94-4c0b-a1ac-4567ef77ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.169963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-39617781-4e94-4c0b-a1ac-4567ef77ba0d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:20.172032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-39617781-4e94-4c0b-a1ac-4567ef77ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:20.197473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6eb99-d14d-4b2c-b764-74678b14afbb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.237981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.244041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.244041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.244041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.250576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:20.252080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:20.267147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 326/636] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:20.267667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:20.268875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:20.270514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:20.272063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39617781-4e94-4c0b-a1ac-4567ef77ba0d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.273824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 311/637] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:20.280040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.284244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:20.330142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:20.377751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39617781-4e94-4c0b-a1ac-4567ef77ba0d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.385794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720505db-d8eb-4aad-87d9-2c93b7ce7e34 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.415481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962b25-360d-45ca-a683-ca8e049314a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.416157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962b25-360d-45ca-a683-ca8e049314a7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.416443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962b25-360d-45ca-a683-ca8e049314a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.416724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962b25-360d-45ca-a683-ca8e049314a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.424408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.425086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.425351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.425620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.426461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:20.427031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:20.428342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:20.446540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 312/638] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:20.451712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.487604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962b25-360d-45ca-a683-ca8e049314a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:20.489103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962b25-360d-45ca-a683-ca8e049314a7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:20.505154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:20.560360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8522172-c8f6-446f-9434-cdbd78b082dc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.570174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:20.600200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.601213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.601502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.601783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.602196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 327/639] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:20.603415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f399df-92fb-4097-a89a-012aaf9acec7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.603709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f399df-92fb-4097-a89a-012aaf9acec7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.603990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f399df-92fb-4097-a89a-012aaf9acec7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.608166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 328/640] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:20.608166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f399df-92fb-4097-a89a-012aaf9acec7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.618974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:20.626848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:20.627790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:20.628696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 313/641] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:20.629407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.718711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f399df-92fb-4097-a89a-012aaf9acec7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.732159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:20.737573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411b71-8b6b-4fa5-8d9c-071a340e1e16 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:20.760164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.760164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.760164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.760164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.784302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71bf44-cd31-4f32-ab77-ee7e9305686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:20.785272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71bf44-cd31-4f32-ab77-ee7e9305686e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.785562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71bf44-cd31-4f32-ab77-ee7e9305686e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.785815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71bf44-cd31-4f32-ab77-ee7e9305686e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.797565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71bf44-cd31-4f32-ab77-ee7e9305686e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:20.799062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71bf44-cd31-4f32-ab77-ee7e9305686e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0c71bf44-cd31-4f32-ab77-ee7e9305686e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:20.817129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:20.818080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:20.818981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:20.818981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:20.818981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:20.818981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:20.818981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 314/642] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:20.820483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68f37-02c6-49e3-bbe6-f843165196eb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:20.820483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68f37-02c6-49e3-bbe6-f843165196eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:20.820652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68f37-02c6-49e3-bbe6-f843165196eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:20.837710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2ac68f37-02c6-49e3-bbe6-f843165196eb None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:20.838907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2ac68f37-02c6-49e3-bbe6-f843165196eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:20.839038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:20.840521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:20.854120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:20.911373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 315/643] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:20.913055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68f37-02c6-49e3-bbe6-f843165196eb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.951829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 329/644] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:20.951829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:20.964951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.029805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68f37-02c6-49e3-bbe6-f843165196eb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.058576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa122-df7d-4c62-bed9-7eb439eef270 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.064188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.064859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.065140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.065483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.066244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:21.066552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.068005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.076660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 316/645] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:21.081746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.096788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.097462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.097749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.098030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.098270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.098755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:21.099073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.101061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.112828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 330/646] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:21.113546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.190730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.198036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2f1e3-7021-42b6-9466-19399755c14f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.225208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cfd3-effb-4fdb-b1b9-2d32c7a4ac36 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.237282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.238335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.238993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.238993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.250608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:21.259283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:21.260228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:21.266143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:21.266844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.266844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.266844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.266844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.267094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 317/647] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:21.267094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.279202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.280702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:21.298379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:21.299402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:21.300990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:21.300990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:21.300990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:21.300990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:21.300990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 331/648] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:21.300990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.351345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.386138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06233-1ba4-4923-9062-fe1dc7bf327a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.408303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724afc7-94c9-4015-abe3-71edfee76892 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.423091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.423893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.424211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.424489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.432769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.435744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.437475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.446364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.447332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.447611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.447995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.454995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:21.456226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:21.457090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:21.457956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:21.457956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:21.457956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:21.457956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:21.458190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.458262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 318/649] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:21.458262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:21.477105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:21.478025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:21.478893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 332/650] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:21.479948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.574174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e41cf-f8ba-45f1-bc67-479741a7b4cf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.586859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40790575-f126-4260-91e9-5cdd73b25836 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.599147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.611725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.612377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.612662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.612939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.613708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:21.614020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.615442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.625637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 319/651] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:21.630036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.630683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.630787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.630980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.631255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.632213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:21.632524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.633889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.650947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 333/652] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:21.650947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.697148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.743927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181978e1-8617-4825-b651-9c453a47dd23 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.765285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad41ae1-54f1-404f-8022-e223bd753570 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.785688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.786464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.786823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.787173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.788582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:21.789020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.790410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.802576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 320/653] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:21.805818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.805950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.805950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.805950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.805950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.806372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:21.806454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.807852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.820457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 334/654] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:21.821251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.851326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.905864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e83fb-0c9c-400f-aeb1-ec633566b97e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.923239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8db695-ecdd-4dc9-b320-63e02c1e48c2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:21.925594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:21.939674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc877b-d8fd-4768-a148-601e9827781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.940494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc877b-d8fd-4768-a148-601e9827781d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.940780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc877b-d8fd-4768-a148-601e9827781d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.941056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc877b-d8fd-4768-a148-601e9827781d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.951465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc877b-d8fd-4768-a148-601e9827781d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.952960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc877b-d8fd-4768-a148-601e9827781d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.959346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:21.960832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.961088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.961772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.969004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:21.970449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d0bc877b-d8fd-4768-a148-601e9827781d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:21.971975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:21.972904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:21.973769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:21.973769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:21.973769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:21.973769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:21.973769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 321/655] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:21.974530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75380f9-90c6-4109-b656-b6f385082396 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:21.974692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75380f9-90c6-4109-b656-b6f385082396 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:21.974933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75380f9-90c6-4109-b656-b6f385082396 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:21.976550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 322/656] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:21.977120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75380f9-90c6-4109-b656-b6f385082396 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:21.987626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:21.988797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 335/657] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:21.994471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.075159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:22.082175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75380f9-90c6-4109-b656-b6f385082396 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.090938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d1864-3b80-42ff-9e14-69d8725a8917 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.117353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ba59e-5ae0-47fe-9140-9659e0a8aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.118142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ba59e-5ae0-47fe-9140-9659e0a8aa20 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.118428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ba59e-5ae0-47fe-9140-9659e0a8aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.118706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ba59e-5ae0-47fe-9140-9659e0a8aa20 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.123639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.124325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.124618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.124899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.125634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ba59e-5ae0-47fe-9140-9659e0a8aa20 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:22.125749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=44ef983c46894dc6bff7fff34cc4e50e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:22.126046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:22.127083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ba59e-5ae0-47fe-9140-9659e0a8aa20 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:22.127468 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:22.133775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 336/658] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/role_assignments?user.id=44ef983c46894dc6bff7fff34cc4e50e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:22.134559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-264ba59e-5ae0-47fe-9140-9659e0a8aa20 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:22.142352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:22.143539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:22.144788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 323/659] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:22.145384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d88e83-5bd8-475a-95ce-e1dca48091ac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.145384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d88e83-5bd8-475a-95ce-e1dca48091ac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.145512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d88e83-5bd8-475a-95ce-e1dca48091ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.165038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-35d88e83-5bd8-475a-95ce-e1dca48091ac None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:22.166194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-35d88e83-5bd8-475a-95ce-e1dca48091ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:22.181294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:22.252206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 324/660] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:22.258646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d88e83-5bd8-475a-95ce-e1dca48091ac None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.270365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b913a3-ef44-493d-b6fc-8b15e2e59c36 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.313338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.314005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.314531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.314666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.315337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:22.315646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:22.317078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:22.331933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 337/661] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:22.332795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.373057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:22.383973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d88e83-5bd8-475a-95ce-e1dca48091ac None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.420322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.420908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.421191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.421466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.422290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:22.422599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:22.424078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:22.436473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:22.437130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 325/662] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:22.440550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.449655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265de1-3726-4fc3-96ca-7299f17d5509 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.486397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.487079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.487365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.487641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.488531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:22.488841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:22.490268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:22.512146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 338/663] 10.222.0.69 () {56 vars in 1137 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:22.512146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.566381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ce49e-82ee-4bd6-9626-f2ccd8847ef4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.614062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.615249 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.616304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.616793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.633213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:22.642976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:22.644055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:22.644916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:22.650134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 326/664] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:22.650134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.663529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:22.663708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049e364-2280-404d-b067-0b91c9c054aa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.703504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.704396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.704665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.704939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.714467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:22.715952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:22.733495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:22.734480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:22.735409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 339/665] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:22.736007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.745894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:22.786738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed45f8-4efc-4465-a5c3-a84d5600059a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.826536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.827862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.828177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.828477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:22.829690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=9e36af3331a04e13b05fcbb8b2d9cd1e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:22.829824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:22.833962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:22.841274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 327/666] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/role_assignments?user.id=9e36af3331a04e13b05fcbb8b2d9cd1e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:22.842292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:22.905085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc42dc-933e-4a68-87c2-c0cb2b707ab6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:22.947320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:22.970012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:22.971520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:22.972679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:22.973209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.008415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27db6-747f-477b-9883-b4bef59cb821 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.053812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:23.054499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:23.054783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:23.055062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.055828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:23.056189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.058681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.074511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 328/667] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:23.075218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.125241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.127047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.136573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:23.213005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2b40a-276f-4ec4-b468-319c33dcd2a2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.252985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:23.253872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:23.254166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:23.254700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.255559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:23.255869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.258264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.258403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 340/668] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:23.259369 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.264403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:23.285960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 329/669] 10.222.0.69 () {56 vars in 1139 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:23.286822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.388663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0a33-da52-4061-8e49-9dfcb62a7418 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.399171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:23.411637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc4ce-5d17-489e-8fab-77f926f8ebeb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.430141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:23.431060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:23.431495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:23.431845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.443438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.446056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.452351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:23.453150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:23.453432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:23.453711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.466052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:23.466391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:23.468305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:23.470415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:23.470415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:23.470415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:23.470415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:23.470921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.476139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 341/670] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:23.476139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:23.486510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:23.488552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:23.490933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:23.490933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:23.490933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:23.490933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:23.490933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 330/671] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:23.490933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.540709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:23.607439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156cc1b-a445-4c68-ad65-fc4f5a89a232 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.609433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3d90b-73c7-4df3-b043-c2e2089ecf2f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.643731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:23.644783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:23.645272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:23.646162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.647097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:23.648211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.649818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.650935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:23.651574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:23.652008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:23.652350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.667517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 331/672] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:23.668711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.683319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:23.734041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.735944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.786098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6876eab-7660-45ff-9bfe-1bb6e50371a9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.789183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:23.831009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:23.831910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:23.832228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:23.832508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:23.833521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:23.833837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:23.835554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:23.856172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 332/673] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:23.858118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.867515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 342/674] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:23.868500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:23.936549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:23.984838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e04e8-f50c-4295-b20d-7341534f4328 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:23.993773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc6a5c-b74e-475e-b88a-f0b56dd0d248 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.034312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.035804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.036503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.037167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.047312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.049251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:24.065945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:24.066937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:24.067858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:24.071325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 333/675] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:24.072441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:24.101632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:24.158104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.159211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.159652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.160127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.169639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.171580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:24.189311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:24.190238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:24.191153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:24.193509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fef50-f3a5-4799-8bec-5b1162a20cd2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.194093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 343/676] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:24.195332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:24.246691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.247596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.247964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.248571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.262662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.264902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:24.288657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:24.289631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:24.290546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:24.290546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:24.290546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:24.290546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:24.297218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 334/677] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:24.298316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:24.312249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76b18-dd27-4004-bc13-cb6f8d1f47b9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.335699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:24.359790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.360430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.360711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.360985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.362512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:24.362826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.364631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.395033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 344/678] 10.222.0.69 () {56 vars in 1135 bytes} [Thu May 26 17:47:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:24.395033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:24.397538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:24.425779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6b423-d7bb-4f2d-989f-4d0730b28413 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.469479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.470144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.470428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.470705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.471496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:24.471950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.473934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.492118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 335/679] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:24.493316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:24.514011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdaa1d-6a82-4723-a1ad-b6a0a34e66ec None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.559389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.560940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.561247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.561699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.563083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:24.563640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.566192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.577974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 345/680] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:24.578801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:24.611986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d56db-dc43-4f69-866e-4f74f910281b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.616238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:24.645718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.646620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.646894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.647797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.651858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:24.690309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412b419-85df-47e3-ab86-1c5b76998916 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.723382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.726081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.726946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c097c-8d5b-40db-b602-0635390bd8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.727673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c097c-8d5b-40db-b602-0635390bd8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.728041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c097c-8d5b-40db-b602-0635390bd8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.728340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c097c-8d5b-40db-b602-0635390bd8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.729166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c097c-8d5b-40db-b602-0635390bd8c0 None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=0d8e2195d53743f78c58cebdcd850fb5) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:24.729494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c097c-8d5b-40db-b602-0635390bd8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.730882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c097c-8d5b-40db-b602-0635390bd8c0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.744049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 346/681] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:24 2022] GET /identity/v3/role_assignments?user.id=0d8e2195d53743f78c58cebdcd850fb5&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:24.744049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4fce3-ad1c-4dae-a075-16819465975c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.744049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4fce3-ad1c-4dae-a075-16819465975c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.744049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4fce3-ad1c-4dae-a075-16819465975c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.744049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 347/682] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:24.744049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4fce3-ad1c-4dae-a075-16819465975c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:24.872342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:24.878104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4fce3-ad1c-4dae-a075-16819465975c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:24.922512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61887c-9c01-4d1c-bf3e-f2a9d6a3c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:24.923607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61887c-9c01-4d1c-bf3e-f2a9d6a3c312 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.924076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61887c-9c01-4d1c-bf3e-f2a9d6a3c312 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.924502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61887c-9c01-4d1c-bf3e-f2a9d6a3c312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.934119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61887c-9c01-4d1c-bf3e-f2a9d6a3c312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:24.935984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61887c-9c01-4d1c-bf3e-f2a9d6a3c312 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4f61887c-9c01-4d1c-bf3e-f2a9d6a3c312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:24.952804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:24.953939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:24.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:24.957511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 348/683] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:24.959164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a8605-2834-47ec-80fe-d2f24bcf39b4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:24.959630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a8605-2834-47ec-80fe-d2f24bcf39b4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:24.960077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a8605-2834-47ec-80fe-d2f24bcf39b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:24.979491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9f4a8605-2834-47ec-80fe-d2f24bcf39b4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:24.981009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9f4a8605-2834-47ec-80fe-d2f24bcf39b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:25.020095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 336/684] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:25.021590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.064996 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:25.069508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 349/685] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:25.072722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a8605-2834-47ec-80fe-d2f24bcf39b4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.154495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f6703-7b08-4688-9bc9-e0bfcf3c27be None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.190620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:25.205832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a8605-2834-47ec-80fe-d2f24bcf39b4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.211662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.212616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.213100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.214153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.215169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:25.216146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.218456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.237073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 337/686] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:25.238239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.246849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.247654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.247940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.248261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.259863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.261367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:25.283449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:25.284685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:25.285550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:25.285550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:25.285550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:25.285550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:25.289284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 350/687] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:25.290163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.376043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:25.384846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084d841-a07f-447e-8e15-6411e8f5a12a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.400600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa84c6-65e5-4e6b-b6e7-d5aa12c7198b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.422964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a6278-6232-47e2-abe4-f92a55d214df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.423766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6278-6232-47e2-abe4-f92a55d214df None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.424135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6278-6232-47e2-abe4-f92a55d214df None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.424790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6278-6232-47e2-abe4-f92a55d214df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.435897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a6278-6232-47e2-abe4-f92a55d214df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.437542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a6278-6232-47e2-abe4-f92a55d214df None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.440279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.440905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.441190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.441469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.442306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=eadb39271321475ebb10382db43db0b3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:25.442622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.444645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.459717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 351/688] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/role_assignments?user.id=eadb39271321475ebb10382db43db0b3&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:25.459717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7e5a6278-6232-47e2-abe4-f92a55d214df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:25.460743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:25.461552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 338/689] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a294-df5c-4705-9d8a-e2b03ea1b083 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a294-df5c-4705-9d8a-e2b03ea1b083 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a294-df5c-4705-9d8a-e2b03ea1b083 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 339/690] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:25.466446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a294-df5c-4705-9d8a-e2b03ea1b083 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.475293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:25.600992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a294-df5c-4705-9d8a-e2b03ea1b083 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.612562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e828b9-a371-4e36-b773-bd4186b1aa4a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.641441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca760646-21a4-406a-b8a4-48d42bb33082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.642161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca760646-21a4-406a-b8a4-48d42bb33082 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.642447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca760646-21a4-406a-b8a4-48d42bb33082 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.642782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca760646-21a4-406a-b8a4-48d42bb33082 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.644050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca760646-21a4-406a-b8a4-48d42bb33082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:25.644050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca760646-21a4-406a-b8a4-48d42bb33082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.645476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca760646-21a4-406a-b8a4-48d42bb33082 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.661200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 340/691] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:25.662449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.663255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6641-721e-49c4-b09c-ed626d13eeca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.663555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6641-721e-49c4-b09c-ed626d13eeca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.663839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6641-721e-49c4-b09c-ed626d13eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.664541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.665030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.665598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.666737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:25.667255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.668980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.684353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-573a6641-721e-49c4-b09c-ed626d13eeca None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:25.685540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-573a6641-721e-49c4-b09c-ed626d13eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:25.687309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 352/692] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:25.687776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:25.689273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.774417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:25.790859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 341/693] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:25.792245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6641-721e-49c4-b09c-ed626d13eeca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.816328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6ce54-a05d-4311-b825-4675a01c7a84 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.854227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.854906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.855191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.855586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.856526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.858054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.884052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 353/694] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:47:25 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:25.885013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:25.915047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6641-721e-49c4-b09c-ed626d13eeca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:25.962159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:25.963060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:25.963539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:25.963944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:25.973460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:25.975111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:25.977898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:25.995199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:25.996364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:25.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:25.999811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 342/695] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:26.005184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:26.065155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876950db-df8a-408e-ae9c-bfd73efea140 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:26.095009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:26.108386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:26.109332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:26.109624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:26.109910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:26.122821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:26.130823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:26.132531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:26.133360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 354/696] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:26.140815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:26.241407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098ea9-7df9-44c9-952c-acd2f94eb118 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:26.260829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d6f6-87d8-4b44-a6b7-7c651390c08d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:26.278236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:26.279227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:26.279505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:26.279790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:26.280819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:26.281417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:26.282870 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:26.301948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:26.302211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 343/697] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:26.302630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:26.302923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:26.303240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:26.304619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:26.305002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:26.306459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:26.310417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:26.318119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 355/698] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:26.324142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:26.380553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:26.384077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:26.431069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c271-b799-49eb-bc90-48b82fab328f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:26.432492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539cc8c-921c-4f15-9bf1-f58b425f7296 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:26.471639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:26.472009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:26.472343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:26.472629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:26.472837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:26.472962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:26.473556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:26.473739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=0dc7da9d33b941dc91a98c8adbb545d9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:26.473978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:26.474117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:26.476963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:26.483773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 344/699] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:26 2022] GET /identity/v3/role_assignments?user.id=0dc7da9d33b941dc91a98c8adbb545d9&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:26.486113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:26.487636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:26.507658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:26.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:26.511789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:26.511789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:26.511789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:26.511789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:26.511789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 356/700] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:26.514584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:26.636168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a0fb1-0976-4201-b386-89dcdcb0d7d2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:26.662332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:26.678802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:26.679526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:26.679816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:26.680129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:26.680876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:26.681191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:26.682588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:26.695644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 345/701] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:26.701002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:26.809268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:26.815694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45a257-6522-4618-92f1-aa6f59535202 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:26.852640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:26.853442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:26.853727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:26.854001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:26.861573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:26.863019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:26.878101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:26.879087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:26.880039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 357/702] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:47:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:26.887060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:27.002610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee19ab-0e92-417d-bd29-c45df67f7c7f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:27.040772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b31d3-3340-4ab8-8407-e40ef763c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:27.041841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b31d3-3340-4ab8-8407-e40ef763c67a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:27.042347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b31d3-3340-4ab8-8407-e40ef763c67a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:27.042824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b31d3-3340-4ab8-8407-e40ef763c67a None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:27.043874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b31d3-3340-4ab8-8407-e40ef763c67a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:27.044431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b31d3-3340-4ab8-8407-e40ef763c67a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:27.046069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b31d3-3340-4ab8-8407-e40ef763c67a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:27.066098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 346/703] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:47:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:27.071275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:27.205079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e487ca-33bc-429d-99da-55aa64d207ff None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:27.253812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:27.254461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:27.254746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:27.255024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:27.291681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:27.352362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:27.353741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:27.357020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fdae0-9d61-499d-811d-1c6fe12cb291 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:27.357387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fdae0-9d61-499d-811d-1c6fe12cb291 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:27.357742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fdae0-9d61-499d-811d-1c6fe12cb291 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:27.359433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 347/704] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:27.364917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfff65-e7c5-48a4-aedc-970fab693bd0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:27.365212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfff65-e7c5-48a4-aedc-970fab693bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:27.365497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfff65-e7c5-48a4-aedc-970fab693bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:27.408560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-48cfff65-e7c5-48a4-aedc-970fab693bd0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:27.409772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48cfff65-e7c5-48a4-aedc-970fab693bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:27.478273 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:27.505166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 358/705] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:27.512426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:27.539122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 348/706] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:27.577147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfff65-e7c5-48a4-aedc-970fab693bd0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:27.579031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:27.627033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a167ac-4549-4d6a-a9b8-1894949d7d00 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:27.664052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:27.665991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:27.665991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:27.665991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:27.676519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:27.678824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:27.697648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:27.698745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:27.699829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:27.699829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:27.699829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:27.699829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:27.701431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 359/707] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:27.708040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:27.800270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfff65-e7c5-48a4-aedc-970fab693bd0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:27.873541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc076b-a623-41f4-a07d-14e94cf5b42d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:27.883250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:27.893646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:27.894467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:27.894751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:27.895027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:27.896035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:27.897766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:27.909930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:27.910605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:27.910897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:27.911181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:27.911921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:27.912265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:27.914410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:27.927544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 360/708] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:27.933511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:27.936651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:27.937646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:27.939475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 349/709] 10.222.0.69 () {56 vars in 1129 bytes} [Thu May 26 17:47:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:27.943861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:28.035267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608831-aaa5-4bd5-99b5-f65fd3e6e3e2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:28.051014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:28.074936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:28.075758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.076068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.076350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.084775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:28.086859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:28.103506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:28.105609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:28.107842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 361/710] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:28.111640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:28.143740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:28.231203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d8cf2-a5bf-417c-9e74-f44c1caed7ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:28.273363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:28.274017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.274306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.274587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.275298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbdd78-fc5e-4a7a-8c6f-6ccd21903db6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:28.275477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:28.275638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:28.277385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:28.283438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 350/711] 10.222.0.69 () {56 vars in 1124 bytes} [Thu May 26 17:47:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:28.292398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:28.332211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2980cc-dd1f-43d6-8113-1ce07feabf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:28.332880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2980cc-dd1f-43d6-8113-1ce07feabf2e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.333166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2980cc-dd1f-43d6-8113-1ce07feabf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.333445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2980cc-dd1f-43d6-8113-1ce07feabf2e None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.334298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2980cc-dd1f-43d6-8113-1ce07feabf2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:28.335383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2980cc-dd1f-43d6-8113-1ce07feabf2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:28.336927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2980cc-dd1f-43d6-8113-1ce07feabf2e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:28.349533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 362/712] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:28.351751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863985ea-739d-4ea8-83d5-69fb6bed9d12 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.352069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863985ea-739d-4ea8-83d5-69fb6bed9d12 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.352355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863985ea-739d-4ea8-83d5-69fb6bed9d12 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.353868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 363/713] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:28.358707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863985ea-739d-4ea8-83d5-69fb6bed9d12 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:28.414458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75e430-4b7f-47a9-8147-a4e974059cd5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:28.450933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7330df-22af-4cf8-ad51-84ea59b4b86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:28.451614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7330df-22af-4cf8-ad51-84ea59b4b86e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.451903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7330df-22af-4cf8-ad51-84ea59b4b86e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.452229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7330df-22af-4cf8-ad51-84ea59b4b86e None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.452959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7330df-22af-4cf8-ad51-84ea59b4b86e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:28.453272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7330df-22af-4cf8-ad51-84ea59b4b86e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:28.453598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:28.455259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7330df-22af-4cf8-ad51-84ea59b4b86e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:28.457307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:28.466293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 351/714] 10.222.0.69 () {56 vars in 1124 bytes} [Thu May 26 17:47:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:28.472714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2034e3-1416-4a77-8bb9-568e1f99dae7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.473716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2034e3-1416-4a77-8bb9-568e1f99dae7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.474762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2034e3-1416-4a77-8bb9-568e1f99dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.477704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863985ea-739d-4ea8-83d5-69fb6bed9d12 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:28.513581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cf2034e3-1416-4a77-8bb9-568e1f99dae7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:28.516609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cf2034e3-1416-4a77-8bb9-568e1f99dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:28.546785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:28.548081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.548545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.548972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.549974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=9e36af3331a04e13b05fcbb8b2d9cd1e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:28.550443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:28.552183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:28.566349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 364/715] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:28 2022] GET /identity/v3/role_assignments?user.id=9e36af3331a04e13b05fcbb8b2d9cd1e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:28.654750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 352/716] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:28.689096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:28.813105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04166f-6703-4b74-bf08-49968b13fd52 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:28.866627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68268700-e57b-4370-bffe-03973f608631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:28.867450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68268700-e57b-4370-bffe-03973f608631 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:28.867736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68268700-e57b-4370-bffe-03973f608631 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:28.868091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68268700-e57b-4370-bffe-03973f608631 None admin] PATH_INFO: `/v3/services/network` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:28.868761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68268700-e57b-4370-bffe-03973f608631 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:28.870188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68268700-e57b-4370-bffe-03973f608631 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-68268700-e57b-4370-bffe-03973f608631 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:28.889632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:28.890666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:28.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:28.896257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 365/717] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:28 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:28.897558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2034e3-1416-4a77-8bb9-568e1f99dae7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:29.052459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:29.058224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2034e3-1416-4a77-8bb9-568e1f99dae7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:29.066301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71912b8-89ed-443c-b364-dd9c90f77bef None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.066950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71912b8-89ed-443c-b364-dd9c90f77bef None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.067441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71912b8-89ed-443c-b364-dd9c90f77bef None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.069372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 366/718] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:29.078681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f92fe6-012c-4906-a573-e6eb1a7c873c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.079252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f92fe6-012c-4906-a573-e6eb1a7c873c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.079741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f92fe6-012c-4906-a573-e6eb1a7c873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.110042 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-96f92fe6-012c-4906-a573-e6eb1a7c873c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:29.111874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-96f92fe6-012c-4906-a573-e6eb1a7c873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:29.131040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:29.131964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.132281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.132565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.133292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:29.133606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:29.134991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:29.135853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:29.146042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 353/719] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:29.153208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:29.255538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 367/720] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:47:29.285776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d39e-ec2a-457f-889c-2e6a74190f3c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:29.293453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f92fe6-012c-4906-a573-e6eb1a7c873c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:29.372370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64870c71-88b4-4ae0-9e24-bc095ba1c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:29.373019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64870c71-88b4-4ae0-9e24-bc095ba1c31f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.373310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64870c71-88b4-4ae0-9e24-bc095ba1c31f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.373584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64870c71-88b4-4ae0-9e24-bc095ba1c31f None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.374309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64870c71-88b4-4ae0-9e24-bc095ba1c31f None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:29.374620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64870c71-88b4-4ae0-9e24-bc095ba1c31f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:29.376026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64870c71-88b4-4ae0-9e24-bc095ba1c31f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:29.391062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 354/721] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:29.451561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f92fe6-012c-4906-a573-e6eb1a7c873c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:29.497906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:29.498741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.499027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.499306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.512175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:29.514977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3cb6-ac1f-4211-b194-90e4ab44b9e3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.515446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3cb6-ac1f-4211-b194-90e4ab44b9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.515525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3cb6-ac1f-4211-b194-90e4ab44b9e3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.517156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 355/722] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:29.520451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:29.521620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:29.522491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:29.523136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7699873-3de9-44f0-8cc1-34c623923f72 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.523136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7699873-3de9-44f0-8cc1-34c623923f72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.523136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7699873-3de9-44f0-8cc1-34c623923f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.527606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 368/723] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:29.528769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:29.542093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:29.545058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c7699873-3de9-44f0-8cc1-34c623923f72 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:29.546275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7699873-3de9-44f0-8cc1-34c623923f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:29.563448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:29.648129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 356/724] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:47:29.670875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7699873-3de9-44f0-8cc1-34c623923f72 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:29.711549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2a1e-2aa6-4e52-9ba4-c5643060a37c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:29.762190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:29.763155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.763441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.763722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.764523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:29.764979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:29.767090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:29.779856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 369/725] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:29.788364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:29.812499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7699873-3de9-44f0-8cc1-34c623923f72 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:29.849095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:29.850590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.851033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.851311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:29.863096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:29.869705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:29.885657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:29.886880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:29.887894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 357/726] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:29.894482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:29.920393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:29.922877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babed53d-7702-4588-830c-30581a5ef052 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:29.979683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:29.980757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:29.981214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:29.981642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.010257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.013213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:30.035658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:30.036633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:30.037538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:30.037538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:30.037538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:30.037538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:30.045508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 370/727] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:30.047290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:30.112335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20687f7c-8d68-40e2-9157-3b64de138aac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:30.184381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:30.185066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:30.185354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:30.185633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.186396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:30.186712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.188137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:30.208948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 358/728] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:30.214979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:30.222082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a472ac-1c7f-4d4c-bd8b-cf67c72a5f8f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:30.242507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:30.262294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:30.262913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:30.263201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:30.263481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.264372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:30.264575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.266174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:30.279961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 371/729] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:30.285293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:30.367990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:30.418240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a299b57-dc75-4a77-b5ec-0d35ce820b6c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:30.457182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:30.457922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:30.458214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:30.458501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.470622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.472216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:30.491178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:30.492468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:30.493743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:30.493743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:30.493743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:30.493743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:30.493743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 359/730] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:30.495655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17dabc-bcf1-48bd-b21a-843f5cfde211 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:30.498469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:30.618036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87df77-6f4c-4acf-ab87-c73d34047e47 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:30.624780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:30.625621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:30.625905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:30.626178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.648383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:30.652887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.654358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:30.663920 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:30.664628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:30.664915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:30.665195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.665943 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:30.666255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.670865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:30.686223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:30.687191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:30.688327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 372/731] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:47:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:30.693399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:30.696874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 360/732] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:30.704101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:30.751622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:30.817196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b0a1-8083-42eb-a8f8-1ff9bd69ef1c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:30.855022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:30.855706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:30.855993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:30.856318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.857172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:30.857484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.861441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:30.894186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 373/733] 10.222.0.69 () {56 vars in 1149 bytes} [Thu May 26 17:47:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:30.902202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:30.934592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850cd91-7a78-4871-b97d-7b88065c8717 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:30.977465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:30.978285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:30.978569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:30.978842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:30.987680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:30.989381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:31.007677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:31.008758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:31.010291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 361/734] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:31.015161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:31.082124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:31.130895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a1eef-cd00-4ae1-ac0c-71882ab29508 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:31.171832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4bfc2-d81b-4ae3-aa9a-b2a8867d43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:31.172553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4bfc2-d81b-4ae3-aa9a-b2a8867d43c9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.172881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4bfc2-d81b-4ae3-aa9a-b2a8867d43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.173520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4bfc2-d81b-4ae3-aa9a-b2a8867d43c9 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.174390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4bfc2-d81b-4ae3-aa9a-b2a8867d43c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:31.174708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4bfc2-d81b-4ae3-aa9a-b2a8867d43c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:31.176792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4bfc2-d81b-4ae3-aa9a-b2a8867d43c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:31.197493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 362/735] 10.222.0.69 () {56 vars in 1135 bytes} [Thu May 26 17:47:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:31.198824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3649f6-2e03-4b45-b5c3-1218a390e0c3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.199114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3649f6-2e03-4b45-b5c3-1218a390e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.199387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3649f6-2e03-4b45-b5c3-1218a390e0c3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.202502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:31.210384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 363/736] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:31.210384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3649f6-2e03-4b45-b5c3-1218a390e0c3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:31.210662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1200b0b-036b-4685-96db-25d2623ef213 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:31.249680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd12c8d-9f78-4438-bf9c-84207a4e8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:31.250675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12c8d-9f78-4438-bf9c-84207a4e8740 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.251190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12c8d-9f78-4438-bf9c-84207a4e8740 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.251529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12c8d-9f78-4438-bf9c-84207a4e8740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.324634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd12c8d-9f78-4438-bf9c-84207a4e8740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:31.325322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3649f6-2e03-4b45-b5c3-1218a390e0c3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:31.325992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd12c8d-9f78-4438-bf9c-84207a4e8740 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:31.327612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:31.369880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d30f0-4a12-40b3-ab63-338a3bed2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:31.370814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d30f0-4a12-40b3-ab63-338a3bed2329 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.371108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d30f0-4a12-40b3-ab63-338a3bed2329 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.371393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d30f0-4a12-40b3-ab63-338a3bed2329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.424316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:31.432195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 374/737] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:31.433516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167054f1-39bb-44aa-8934-3ffc70a49264 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.433805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167054f1-39bb-44aa-8934-3ffc70a49264 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.434085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167054f1-39bb-44aa-8934-3ffc70a49264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.452737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-167054f1-39bb-44aa-8934-3ffc70a49264 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:31.453917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-167054f1-39bb-44aa-8934-3ffc70a49264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:31.454356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d30f0-4a12-40b3-ab63-338a3bed2329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:31.456317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d30f0-4a12-40b3-ab63-338a3bed2329 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:31.535514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 375/738] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:31.535514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b948617-d67b-47eb-a6e4-c953af7d495c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.535514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b948617-d67b-47eb-a6e4-c953af7d495c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.535514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b948617-d67b-47eb-a6e4-c953af7d495c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.535514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 376/739] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:31.535514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b948617-d67b-47eb-a6e4-c953af7d495c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:31.585953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 364/740] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:47:31.587095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4ae11-cb51-4571-86dd-8e20240977a5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.587436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4ae11-cb51-4571-86dd-8e20240977a5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.587769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4ae11-cb51-4571-86dd-8e20240977a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.592517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:31.605480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-08a4ae11-cb51-4571-86dd-8e20240977a5 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:31.606654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08a4ae11-cb51-4571-86dd-8e20240977a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:31.659004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b948617-d67b-47eb-a6e4-c953af7d495c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:31.688041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 365/741] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:31.688041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4ae11-cb51-4571-86dd-8e20240977a5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:31.692002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:31.695810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:31.696987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.697363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.697948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.710110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:31.712214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:31.730450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:31.731409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:31.732700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:31.732700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:31.732700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:31.732700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:31.732700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 377/742] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:31.732984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:31.805607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4ae11-cb51-4571-86dd-8e20240977a5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:31.838866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:31.845123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:31.845825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.846115 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.846389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.847108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:31.848517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:31.849671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d721-18d9-4b28-b4dc-548abe267cc7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:31.876490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 366/743] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:47:31 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:31.878222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:31.907366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:31.908214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:31.908497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:31.908771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:31.921963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:31.923621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:31.945459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:31.946432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:31.947326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:31.947326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:31.947326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:31.947326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:31.951698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 378/744] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:31.953035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:31.988822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.016849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0196a5-9021-4703-8f7b-d48f1dbda84d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.056378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.057571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.058097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.058580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.072297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:32.074290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588cf3-faf8-46d7-8bb0-cd0cb0fb6acd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:32.080428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:32.081359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:32.082293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 367/745] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:32.082976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.119994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.120924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.121377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.121810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.122690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:32.123151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.125521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.139301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 379/746] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:32.140448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.153913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.207521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116968-2317-47a6-b80c-cda3597c66cc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.244508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.245342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.245637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.246199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.246948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:32.247265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.248874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.249108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.262871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31b44-ce2e-4ef2-a66a-da22cbbdb470 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.270272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 368/747] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:32.270272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.299001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2f5da-efbb-47a9-8b20-be53a85ede18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.299690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f5da-efbb-47a9-8b20-be53a85ede18 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.299978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f5da-efbb-47a9-8b20-be53a85ede18 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.300283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f5da-efbb-47a9-8b20-be53a85ede18 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.301035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2f5da-efbb-47a9-8b20-be53a85ede18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:32.301344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2f5da-efbb-47a9-8b20-be53a85ede18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.302709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2f5da-efbb-47a9-8b20-be53a85ede18 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.316070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 380/748] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:32.316070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f511-d4d6-419e-a55c-5c06c8df4289 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.316070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f511-d4d6-419e-a55c-5c06c8df4289 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.316070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f511-d4d6-419e-a55c-5c06c8df4289 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.319976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 381/749] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:32.320530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416f511-d4d6-419e-a55c-5c06c8df4289 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.385723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0dea-4acc-477e-a71b-5c965b51e900 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.400412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.423611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.424445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.424728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.425007 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.431443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416f511-d4d6-419e-a55c-5c06c8df4289 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.433251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.434711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:32.450124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:32.451245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:32.452226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 369/750] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:32.452717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.475687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0a32-43ef-4467-a3cb-cbf9a0febb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.476518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0a32-43ef-4467-a3cb-cbf9a0febb12 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.476836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0a32-43ef-4467-a3cb-cbf9a0febb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.477193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0a32-43ef-4467-a3cb-cbf9a0febb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.484582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a0a32-43ef-4467-a3cb-cbf9a0febb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.486140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a0a32-43ef-4467-a3cb-cbf9a0febb12 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f56a0a32-43ef-4467-a3cb-cbf9a0febb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:32.501588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:32.502506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:32.503372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 382/751] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:32.504342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d772a-64f1-4010-b675-ec17a7d16e79 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.504454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d772a-64f1-4010-b675-ec17a7d16e79 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.504669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d772a-64f1-4010-b675-ec17a7d16e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.522535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f27d772a-64f1-4010-b675-ec17a7d16e79 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:32.523975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f27d772a-64f1-4010-b675-ec17a7d16e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:32.527208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.573703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73351-5757-4fbd-9f10-88e825b27c95 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.604049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 383/752] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:47:32.604049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d772a-64f1-4010-b675-ec17a7d16e79 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.620100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.621062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.621429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.621831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.635505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.637243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:32.660330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:32.661306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:32.662241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:32.662241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:32.662241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:32.662241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:32.662241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 370/753] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:32.663303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.708450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.765304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d772a-64f1-4010-b675-ec17a7d16e79 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.823676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ac9e-17c9-436b-a060-0313af6abe41 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:32.826406 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.827418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.827747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.828099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.829363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:32.829871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.832435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.847925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.860346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 384/754] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:32.861936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.873581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:32.874396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:32.874842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:32.875256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:32.876299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:32.876730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:32.878393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:32.898994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 371/755] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:32.898994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:32.984846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:32.999409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf6ab-4dde-4c2a-a0eb-be90b4392db5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:33.004736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634e059-21d3-43cb-a0df-ab49f853d3e5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:33.039259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:33.039934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:33.040249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:33.040531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:33.041262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:33.042638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:33.045901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:33.046835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:33.046983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:33.047188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:33.047940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:33.048362 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:33.049685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:33.062769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 372/756] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:33.063941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 385/757] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:47:32 2022] POST /identity/v3/services => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:33.065935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:33.072489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:33.175370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:33.210583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8e52b-e454-4f8f-82e7-3a3c51711008 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:33.257816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:33.258749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb4f70-82ee-4dfb-9b41-18081be68c9d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:33.258872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:33.259306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:33.259738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:33.260633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=5927394f6adf4fd0b85d6cdeeec358b6) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:33.260944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:33.264350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:33.272577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 373/758] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:33 2022] GET /identity/v3/role_assignments?user.id=5927394f6adf4fd0b85d6cdeeec358b6&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:33.272577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:33.288128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:33.303927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:33.304669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:33.304957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:33.305238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:33.307771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=0dc7da9d33b941dc91a98c8adbb545d9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:33.307771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:33.308102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:33.320050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 386/759] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:33 2022] GET /identity/v3/role_assignments?user.id=0dc7da9d33b941dc91a98c8adbb545d9&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:33.480802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09675bc-d191-4b20-8b74-cd6e4f07929a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:33.549350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:33.551051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:33.551771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:33.552496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:33.566574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:33.569957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:33.596441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:33.598000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:33.599540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:33.603917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 374/760] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:47:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:33.612235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:33.789621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82a3ed-4807-428f-aae7-9685b20bfe4e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:33.822563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:33.840998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:33.841679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:33.841958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:33.842230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:33.843074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:33.843385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:33.844835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:33.876741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 387/761] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:47:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:33.882436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:33.968789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:34.014150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b9684-2fc7-407e-8347-a3fcc7ec0217 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:34.063541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:34.064360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.064643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.064919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.079841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:34.081362 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:34.117620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:34.118566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:34.119442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:34.119442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:34.119442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:34.119442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:34.124181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 375/762] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:34.132235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:34.291375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72de9-adfd-414d-87cc-44633629f342 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:34.331125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc680-8690-42db-ad5b-3033ada418cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:34.332193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc680-8690-42db-ad5b-3033ada418cf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.332694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc680-8690-42db-ad5b-3033ada418cf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.333203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc680-8690-42db-ad5b-3033ada418cf None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.334675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc680-8690-42db-ad5b-3033ada418cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:34.335292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc680-8690-42db-ad5b-3033ada418cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:34.336901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc680-8690-42db-ad5b-3033ada418cf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:34.349450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 388/763] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:34.357188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:34.425538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3a45a-0667-420b-9836-0cc30bfd9d8c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.426188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3a45a-0667-420b-9836-0cc30bfd9d8c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.426693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3a45a-0667-420b-9836-0cc30bfd9d8c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.428332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 389/764] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:47:34.444890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c824-30f7-43fb-bdbd-839382fe4df9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.445199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c824-30f7-43fb-bdbd-839382fe4df9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.445453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c824-30f7-43fb-bdbd-839382fe4df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.477038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d456c824-30f7-43fb-bdbd-839382fe4df9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:34.478305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d456c824-30f7-43fb-bdbd-839382fe4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:34.498882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13eb9c-0718-444c-9360-b90939d57179 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:34.516630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:34.538538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:34.539394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.539685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.539967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.547083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:34.548623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:34.549365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:34.568283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:34.569927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:34.571208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 376/765] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:34.575847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:34.649734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 390/766] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:34.684884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45e53-f372-4e04-83a6-c9a4a0476ac6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:34.698789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c824-30f7-43fb-bdbd-839382fe4df9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:34.723095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:34.723773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.724088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.724371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.725808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:34.726128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:34.727769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:34.741946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 377/767] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:34.747717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:34.832559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:34.883613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff426b72-9852-4b58-b391-19be99e8eeee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:34.892058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c824-30f7-43fb-bdbd-839382fe4df9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:34.922228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:34.923134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.923424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.923706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/9e36af3331a04e13b05fcbb8b2d9cd1e/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.925810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=9e36af3331a04e13b05fcbb8b2d9cd1e, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:34.927260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:34.942540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 378/768] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:34 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/9e36af3331a04e13b05fcbb8b2d9cd1e/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:47:34.974319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:34.975745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:34.976048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:34.976329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:34.977087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:34.978537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:35.015861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:35.016885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:35.017715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:35.024259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 391/769] 10.222.0.69 () {56 vars in 1129 bytes} [Thu May 26 17:47:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:35.029118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:35.176429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57af5-8487-4a85-8593-15cc02991d38 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:35.180269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:35.218208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:35.218895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:35.219182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:35.219464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:35.220222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:35.220534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:35.222677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:35.228786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 379/770] 10.222.0.69 () {56 vars in 1124 bytes} [Thu May 26 17:47:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:35.237631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:35.274897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:35.363949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ac1c3-0e23-4632-9cb7-3d50a1be8aee None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:35.414160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:35.414850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:35.415140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:35.415427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:35.416196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:35.416514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:35.418022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:35.428508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 392/771] 10.222.0.69 () {56 vars in 1124 bytes} [Thu May 26 17:47:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:35.437182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:35.587048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec67c6-058e-4ba2-aa23-5ca8b015db94 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:35.633831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71041e06-cffc-4db5-82c1-95465737291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:35.634866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71041e06-cffc-4db5-82c1-95465737291f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:35.635366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71041e06-cffc-4db5-82c1-95465737291f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:35.635865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71041e06-cffc-4db5-82c1-95465737291f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:35.636886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71041e06-cffc-4db5-82c1-95465737291f None admin] RBAC: Adding query filter params (interface=public, service_id=7e3fc0b835594388b2c25dae49431b8e, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:35.637396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71041e06-cffc-4db5-82c1-95465737291f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:35.638971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71041e06-cffc-4db5-82c1-95465737291f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:35.650758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 380/772] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:47:35 2022] GET /identity/v3/endpoints?service_id=7e3fc0b835594388b2c25dae49431b8e&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:35.659245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:35.836226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:35.843649 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59ae5-9a35-43bf-939f-56b3a5882b0a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:35.891945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a9621-e5ab-42da-ab20-9e62adfd81a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:35.892675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9621-e5ab-42da-ab20-9e62adfd81a5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:35.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9621-e5ab-42da-ab20-9e62adfd81a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:35.893245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a9621-e5ab-42da-ab20-9e62adfd81a5 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:35.893932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a9621-e5ab-42da-ab20-9e62adfd81a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:35.895605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a9621-e5ab-42da-ab20-9e62adfd81a5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:35.902238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 393/773] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:47:35 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:36.184412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f00c3-d097-4b1e-b09e-492e772e5d0e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.184932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f00c3-d097-4b1e-b09e-492e772e5d0e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.185010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f00c3-d097-4b1e-b09e-492e772e5d0e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.186490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 381/774] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:36.192341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06981b-a573-4b7f-8266-dffb6c2ba71d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.192934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06981b-a573-4b7f-8266-dffb6c2ba71d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.193966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06981b-a573-4b7f-8266-dffb6c2ba71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.213907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5e06981b-a573-4b7f-8266-dffb6c2ba71d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:36.215506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5e06981b-a573-4b7f-8266-dffb6c2ba71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:36.222950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9bae6-2e5f-4e3b-b801-1037e9495049 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.223266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9bae6-2e5f-4e3b-b801-1037e9495049 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.223517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9bae6-2e5f-4e3b-b801-1037e9495049 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.225352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 382/775] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:36.232723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ef71-dd57-4cb3-9705-d7d8e229c13b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.233015 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ef71-dd57-4cb3-9705-d7d8e229c13b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.233296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ef71-dd57-4cb3-9705-d7d8e229c13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.258828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1147ef71-dd57-4cb3-9705-d7d8e229c13b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:36.260039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1147ef71-dd57-4cb3-9705-d7d8e229c13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:36.281656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:36.293392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 394/776] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:47:36.323118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06981b-a573-4b7f-8266-dffb6c2ba71d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:36.352559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 383/777] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:36.387339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ef71-dd57-4cb3-9705-d7d8e229c13b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:36.476475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:36.494476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06981b-a573-4b7f-8266-dffb6c2ba71d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:36.534908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ef71-dd57-4cb3-9705-d7d8e229c13b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:36.562196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55defd7f-bc91-4bcf-96eb-262bc18af13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:36.563291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defd7f-bc91-4bcf-96eb-262bc18af13e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.563482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defd7f-bc91-4bcf-96eb-262bc18af13e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.563716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defd7f-bc91-4bcf-96eb-262bc18af13e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.577445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55defd7f-bc91-4bcf-96eb-262bc18af13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:36.578143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b18ba-d737-47e3-8525-2e3a736cadc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:36.579225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b18ba-d737-47e3-8525-2e3a736cadc0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.579715 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b18ba-d737-47e3-8525-2e3a736cadc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.580226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b18ba-d737-47e3-8525-2e3a736cadc0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.581099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b18ba-d737-47e3-8525-2e3a736cadc0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:36.582765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b18ba-d737-47e3-8525-2e3a736cadc0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-55defd7f-bc91-4bcf-96eb-262bc18af13e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:36.586647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:36.587626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:36.588501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:36.592862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 395/778] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:36.594300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71bb41-370b-46f4-b57f-08ec64388ec5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.594593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71bb41-370b-46f4-b57f-08ec64388ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.594876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71bb41-370b-46f4-b57f-08ec64388ec5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.596480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 396/779] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:36.597198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71bb41-370b-46f4-b57f-08ec64388ec5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6b5b18ba-d737-47e3-8525-2e3a736cadc0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:36.602011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:36.603086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:36.603918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:36.606874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 384/780] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:36 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:36.608394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8ffc-18c4-43bb-ae32-be92a0572ffb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.608889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8ffc-18c4-43bb-ae32-be92a0572ffb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.609388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8ffc-18c4-43bb-ae32-be92a0572ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.630358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-41ff8ffc-18c4-43bb-ae32-be92a0572ffb None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:36.632244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41ff8ffc-18c4-43bb-ae32-be92a0572ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:36.648155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:36.708452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 385/781] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:36.710268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8ffc-18c4-43bb-ae32-be92a0572ffb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:36.766770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71bb41-370b-46f4-b57f-08ec64388ec5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:36.807264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:36.807959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.808302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.808588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.809356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:36.809679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:36.811164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:36.822085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8ffc-18c4-43bb-ae32-be92a0572ffb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:36.825876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 397/782] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:36.826825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:36.843098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:36.862391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:36.863378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:36.863911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:36.864431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:36.866148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:36.866683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:36.868373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:36.873937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 386/783] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:36.874991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:36.898025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:36.956339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d4cb-0b1e-43ac-bf7e-276925723d5e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.002027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.003278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.004133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.004714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.014418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171679b-33b0-4973-bef1-4abea837e83b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.019997 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:37.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:37.029878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:37.030730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:37.035515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 398/784] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:37.036544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.062575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.063769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.064329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.064811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.077257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.079134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:37.101191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:37.102152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:37.103032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:37.103032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:37.103032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:37.103032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:37.105551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 387/785] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:37.106677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.125450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:37.171862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984e103-24c8-498c-8484-ee2a2987ea86 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.181089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:37.213915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.214876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.215314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.215737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.216761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] RBAC: Adding query filter params (type=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:37.217220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.218742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.230593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 399/786] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:37.231026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4854-f2b5-4d01-8a43-11a8117b03b6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.232441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.279407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.280660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.281057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.281443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.282735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:37.283154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.285359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.302760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 388/787] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:37.302760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.359517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3900f44-9eba-433e-91c2-3cbd396f9235 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.413584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.414328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.414863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.415148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.416672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:37.416992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.418392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.418561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f2c1c-9631-48d9-84bd-d7f328210d38 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.421901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:37.441197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 400/788] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:37.442178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.451922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:37.464755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.465941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.466455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.466984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.468090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] RBAC: Adding query filter params (interface=public, service_id=a1510cd542924560a4561f73c4753401, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:37.468617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.470285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.481585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 389/789] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/endpoints?service_id=a1510cd542924560a4561f73c4753401&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:37.482791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.568134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969c762-8613-4c8e-ba88-dab459627098 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.608665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.610018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.610532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.611067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.620056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f915-4bf4-44b1-a47a-df2f76bd0e2b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.623263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.625273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:37.645676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:37.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:37.648192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:37.648192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:37.648192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:37.648192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:37.650687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 401/790] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:37.651899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.660741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.661566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.661851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.662633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.673522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.675636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:37.696160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:37.697159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:37.698103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 390/791] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:37.698712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.713559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:37.752640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:37.781692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d107325-26df-42dc-9d86-ea679db16642 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.806809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e192b-bbad-45c8-b392-a0f1a22169bd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.821280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e528c4d-7ec7-4a8e-9b42-4b0e0e25a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.821965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528c4d-7ec7-4a8e-9b42-4b0e0e25a159 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.822255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528c4d-7ec7-4a8e-9b42-4b0e0e25a159 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.822533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528c4d-7ec7-4a8e-9b42-4b0e0e25a159 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.823223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e528c4d-7ec7-4a8e-9b42-4b0e0e25a159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.824624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e528c4d-7ec7-4a8e-9b42-4b0e0e25a159 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.840043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 402/792] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:37.840043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de268-27a0-4b83-a1cd-c3ea34d52d1d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.840043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de268-27a0-4b83-a1cd-c3ea34d52d1d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.840043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de268-27a0-4b83-a1cd-c3ea34d52d1d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.840043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 403/793] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:37.840043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de268-27a0-4b83-a1cd-c3ea34d52d1d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:37.855538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54840c41-5308-4141-a887-7cc8970dcf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:37.856485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840c41-5308-4141-a887-7cc8970dcf65 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.856632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840c41-5308-4141-a887-7cc8970dcf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.856904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840c41-5308-4141-a887-7cc8970dcf65 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.857683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54840c41-5308-4141-a887-7cc8970dcf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:37.857983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54840c41-5308-4141-a887-7cc8970dcf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:37.859384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54840c41-5308-4141-a887-7cc8970dcf65 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:37.873812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 391/794] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:37.875181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84ef-010f-4026-b941-335c55388435 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:37.875473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84ef-010f-4026-b941-335c55388435 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:37.875751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84ef-010f-4026-b941-335c55388435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:37.894955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-57ce84ef-010f-4026-b941-335c55388435 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:37.897012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-57ce84ef-010f-4026-b941-335c55388435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:37.984573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de268-27a0-4b83-a1cd-c3ea34d52d1d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:37.991787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 392/795] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:37.993108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce84ef-010f-4026-b941-335c55388435 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.014950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.049630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.052078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.052078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.052078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.053724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:38.054200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.055690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.059623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.081170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 404/796] 10.222.0.69 () {56 vars in 1149 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:38.081984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.128005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce84ef-010f-4026-b941-335c55388435 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.171776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.173012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.173552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.174026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.182140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.184033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:38.199482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:38.200496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:38.201426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:38.204114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 393/797] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:38.205286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.221925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460a3b-f748-4044-b0a4-f3196369a0bb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.267566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.268565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.268905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.269179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.282008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:38.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:38.291802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:38.292666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:38.295110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 405/798] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:38.296261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.320771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1b5d-ee8c-48bd-a8de-42297ca6fb7b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.340441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.344655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.359893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.360694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.361075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.361448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.372481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.374284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:38.393493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:38.394531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:38.395686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:38.395686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:38.395686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:38.395686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:38.400480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 394/799] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:38.401458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.440128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a492b1-9f9b-4e03-8719-66b68545f781 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.477869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.478658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.479244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.479523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.480679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:38.480990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.482433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.506333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 406/800] 10.222.0.69 () {56 vars in 1135 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:38.508936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.532350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae430-e29c-4dae-adac-75cd55f476e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.573699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.574662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.575161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.575508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.576287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:38.576599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.577969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.592884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 395/801] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:38.592884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.607744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.610043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.621286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d64f4-81cc-47ab-b7b8-4f8535418571 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.657720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de63dd-e8c6-4b62-befc-50432162d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.658413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de63dd-e8c6-4b62-befc-50432162d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.658704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de63dd-e8c6-4b62-befc-50432162d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.658986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de63dd-e8c6-4b62-befc-50432162d4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.659726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de63dd-e8c6-4b62-befc-50432162d4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:38.660062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de63dd-e8c6-4b62-befc-50432162d4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.661452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de63dd-e8c6-4b62-befc-50432162d4d3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.680074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 407/802] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:38.680074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf69f-ba93-486c-8766-a50a1959bc0c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.680074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf69f-ba93-486c-8766-a50a1959bc0c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.680074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf69f-ba93-486c-8766-a50a1959bc0c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.680074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 408/803] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:38.680074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bf69f-ba93-486c-8766-a50a1959bc0c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.713670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a68787-4177-4d75-99b9-025d00728e00 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.759454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.759454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.759454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.759454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.773212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.774684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.792662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bf69f-ba93-486c-8766-a50a1959bc0c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:38.793710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:38.794562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:38.795498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:38.795498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:38.795498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:38.795498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:38.795498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 396/804] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:38.795774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.835358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56959a39-8c7b-494f-95ca-a6dee0140d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.836192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56959a39-8c7b-494f-95ca-a6dee0140d35 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.836484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56959a39-8c7b-494f-95ca-a6dee0140d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.836767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56959a39-8c7b-494f-95ca-a6dee0140d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.847466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56959a39-8c7b-494f-95ca-a6dee0140d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.848883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56959a39-8c7b-494f-95ca-a6dee0140d35 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.858156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.867220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-56959a39-8c7b-494f-95ca-a6dee0140d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:38.868624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:38.869676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:38.870578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:38.870578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:38.870578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:38.870578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:38.877581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 409/805] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:38.878919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cfc49-8f20-4609-b0e5-347c701922f3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.879216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cfc49-8f20-4609-b0e5-347c701922f3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.879498 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cfc49-8f20-4609-b0e5-347c701922f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.897417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f32cfc49-8f20-4609-b0e5-347c701922f3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:38.898619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f32cfc49-8f20-4609-b0e5-347c701922f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:38.905568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e5101-0373-42bd-a348-8d2677ddcc86 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:38.940710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:38.941512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:38.941795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:38.942075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:38.950195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:38.951709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:38.965854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:38.966779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:38.967659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 397/806] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:38.968742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:38.980065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 410/807] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:38.980065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cfc49-8f20-4609-b0e5-347c701922f3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.097011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cfc49-8f20-4609-b0e5-347c701922f3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.101598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf89b2-068d-4d04-ab7b-b9b3f545c393 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.130168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:39.131460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:39.138077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.138801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.139044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.139323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.140073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:39.140380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.141758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.141859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.142441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.142730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.143010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.143749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:39.144087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.145727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.158883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 411/808] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:39.158883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.163301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 398/809] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:39.164295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.263391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edecee-b343-444e-862c-5c5dd01be38c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.274564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b081395-07a4-4b7b-935b-f2204d088864 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.299411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.300115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.300407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.300686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.301518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:39.301841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.303320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.309899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.311005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.311459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.311873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.312826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.314364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.315590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 412/810] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:39.316468 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:39.333095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:39.335009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:47:39.335968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:39.339667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 399/811] 10.222.0.69 () {56 vars in 1129 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:39.340634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.373799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:39.393382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:39.431182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c065a85-4ca4-41ec-bc11-24e515946b7a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.446208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de12e56-5e59-49c6-8b47-fb1effab4a97 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.472952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.474032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.474504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.474925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.483039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.484121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.484913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.485031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.485202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.485484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.493386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.494873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:39.501258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:39.502350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:47:39.503469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:39.510445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:39.511339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:39.512240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:39.512663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 413/812] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:39.512663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.515447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 400/813] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:39.516320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.618775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947a3e2-3af2-485c-80fc-6863be917dcd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.619389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee838-4067-431f-b4be-a13f104b946c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.629930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:39.632400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:39.656784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.657457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.657741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.658027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.658744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:39.659056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.660337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.660457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.661488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.661698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.662865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/5927394f6adf4fd0b85d6cdeeec358b6/roles/3f20b0bae044417383cdf3692e11bed6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.666043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 401/814] 10.222.0.69 () {56 vars in 1124 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:39.667051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.681203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=5927394f6adf4fd0b85d6cdeeec358b6, role_id=3f20b0bae044417383cdf3692e11bed6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.682672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.696987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 414/815] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:39 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/5927394f6adf4fd0b85d6cdeeec358b6/roles/3f20b0bae044417383cdf3692e11bed6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:39.698242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.807287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6bdb6-a446-48ea-9b69-ef7e683ead61 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.850279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.851300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.851769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.852394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.853562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:39.854153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.855826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.856302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2f5e4-b36f-4197-bc21-87a01e3abcd8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:39.886122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 402/816] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:39.886122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.910788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:39.912371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:39.913033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:39.913477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:39.914484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:39.914993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:39.916672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:39.930397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 415/817] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:39.931530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:39.936365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:39.960173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:40.034854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876e582-d79d-4c2c-bd54-647a005be0cf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:40.050896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d95409-e2fd-4730-accd-d4499e2a9dab None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:40.084406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:40.085483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.086004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.086484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.086590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd05a1-378e-43c7-94ab-d749c904a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:40.087144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd05a1-378e-43c7-94ab-d749c904a290 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.087436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd05a1-378e-43c7-94ab-d749c904a290 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.087716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd05a1-378e-43c7-94ab-d749c904a290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.088254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:40.088715 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:40.090250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:40.102933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 403/818] 10.222.0.69 () {56 vars in 1124 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:40.104232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:40.181973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd05a1-378e-43c7-94ab-d749c904a290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:40.183931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd05a1-378e-43c7-94ab-d749c904a290 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:40.212364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:40.220814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:40.228968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a6d0e-8ca3-48e9-9ac3-2f5f6d0e86ee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:40.266420 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:40.267372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.267665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.267959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/0dc7da9d33b941dc91a98c8adbb545d9/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.270025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=0dc7da9d33b941dc91a98c8adbb545d9, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:40.272393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:40.296057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 404/819] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:40 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/0dc7da9d33b941dc91a98c8adbb545d9/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:40.296057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:40.311750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 416/820] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:47:40.313452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453de20b-ffc2-43f1-ba61-5229db8a436c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.313809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453de20b-ffc2-43f1-ba61-5229db8a436c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.314150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453de20b-ffc2-43f1-ba61-5229db8a436c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.321088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 417/821] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:40.322139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453de20b-ffc2-43f1-ba61-5229db8a436c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:40.437767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702734d7-27dc-49bb-a820-a46b610455e0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:40.478763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453de20b-ffc2-43f1-ba61-5229db8a436c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:40.486537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345de63-ddaf-4360-91a8-b1c0ac92bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:40.488091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345de63-ddaf-4360-91a8-b1c0ac92bd63 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.488091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345de63-ddaf-4360-91a8-b1c0ac92bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.488091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345de63-ddaf-4360-91a8-b1c0ac92bd63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.489124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345de63-ddaf-4360-91a8-b1c0ac92bd63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:40.491982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345de63-ddaf-4360-91a8-b1c0ac92bd63 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:40.504866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:40.517598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 405/822] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:47:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:40.522088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39245c-e019-46c3-af72-5a9f56d89b36 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.522592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39245c-e019-46c3-af72-5a9f56d89b36 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.523044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39245c-e019-46c3-af72-5a9f56d89b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.531381 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:40.532709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.533102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.533536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.543391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5f39245c-e019-46c3-af72-5a9f56d89b36 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:40.544953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f39245c-e019-46c3-af72-5a9f56d89b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:40.550510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:40.553332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:40.576419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:40.580627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:40.581674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:40.582688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:40.582688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:40.582688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:40.582688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:40.584908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 418/823] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:40.590799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:40.666094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 406/824] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:40.702428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39245c-e019-46c3-af72-5a9f56d89b36 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:40.764753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218714a-fbd0-4827-b918-9e03465fd098 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:40.821328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:40.822435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.822726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.823269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.824030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:40.824622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:40.826729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:40.828117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39245c-e019-46c3-af72-5a9f56d89b36 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:40.842156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 419/825] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:40.847655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:40.881449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:40.882517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:40.882803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:40.883245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:40.883924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:40.884057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:40.885382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:40.907413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:40.908504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:47:40.909338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:40.912096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 407/826] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:40 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:40.916061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:40.928269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:41.039970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb363ff-4815-4790-85f1-a47cab025a1d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:41.046008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfeb2d-c840-4fd4-ba27-aed51924f2f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:41.076653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:41.077459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:41.077742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:41.078018 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:41.088687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:41.090143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:41.091720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:41.092428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:41.092711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:41.092987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:41.093706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:41.094017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:41.095373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:41.103014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 408/827] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:41.115487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:41.116635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:41.117860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:41.118299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:41.131302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 420/828] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:41.134823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:41.253858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:41.271034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f10d-7a5a-4379-a4bb-fc8a7bd97d3d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:41.277883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:41.314249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:41.314838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:41.315124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:41.315404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:41.316230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:41.316546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:41.320045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:41.332913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 421/829] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:41.341124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:41.348773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3546d-c215-4da9-82c6-8a803ad73073 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:41.417540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:41.420755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:41.421216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:41.421648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:41.422518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:41.423029 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:41.424976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:41.439538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 409/830] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:41.443687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:41.527383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1a6a1-bf20-40b8-866d-789a41b3e6fe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:41.599688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d9229-4773-466b-b85b-582c8adda982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:41.602433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9229-4773-466b-b85b-582c8adda982 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:41.607629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9229-4773-466b-b85b-582c8adda982 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:41.608191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9229-4773-466b-b85b-582c8adda982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:41.609261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9229-4773-466b-b85b-582c8adda982 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=9e36af3331a04e13b05fcbb8b2d9cd1e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:41.609743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9229-4773-466b-b85b-582c8adda982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:41.611427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9229-4773-466b-b85b-582c8adda982 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:41.627513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 422/831] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:41 2022] GET /identity/v3/role_assignments?user.id=9e36af3331a04e13b05fcbb8b2d9cd1e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:41.652387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a5c27-f421-4b05-aef0-ffa23e60a89b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:41.691299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677dec1-a811-4617-b4f9-3839ac824e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:41.692290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677dec1-a811-4617-b4f9-3839ac824e61 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:41.692744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677dec1-a811-4617-b4f9-3839ac824e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:41.693699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677dec1-a811-4617-b4f9-3839ac824e61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:41.694625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677dec1-a811-4617-b4f9-3839ac824e61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:41.696199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677dec1-a811-4617-b4f9-3839ac824e61 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:41.699946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:41.726318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 410/832] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:47:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:42.313299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491e9f-3a1d-4921-bd3b-9d8e6dd0ceaa None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:42.313841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491e9f-3a1d-4921-bd3b-9d8e6dd0ceaa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:42.313841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491e9f-3a1d-4921-bd3b-9d8e6dd0ceaa None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:42.315591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 423/833] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:42.321635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aa6af-0c17-4a64-9fa0-556791945a65 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:42.321919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aa6af-0c17-4a64-9fa0-556791945a65 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:42.322196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aa6af-0c17-4a64-9fa0-556791945a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:42.339216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6a4aa6af-0c17-4a64-9fa0-556791945a65 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:42.340427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6a4aa6af-0c17-4a64-9fa0-556791945a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:42.416698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 411/834] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:42.439782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e491e9f-3a1d-4921-bd3b-9d8e6dd0ceaa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:42.457351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:42.551863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e491e9f-3a1d-4921-bd3b-9d8e6dd0ceaa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:42.593798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:42.594525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:42.594812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:42.595090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:42.606395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:42.614139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:42.615677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:42.617306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 424/835] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:47:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:42.621814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aa6af-0c17-4a64-9fa0-556791945a65 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:42.730926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aa6af-0c17-4a64-9fa0-556791945a65 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:42.748874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:42.776471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba37c-82b7-47d9-8a1c-e08111f0f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:42.777150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba37c-82b7-47d9-8a1c-e08111f0f331 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:42.777433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba37c-82b7-47d9-8a1c-e08111f0f331 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:42.777711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba37c-82b7-47d9-8a1c-e08111f0f331 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:42.778468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba37c-82b7-47d9-8a1c-e08111f0f331 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:42.778777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba37c-82b7-47d9-8a1c-e08111f0f331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:42.780184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba37c-82b7-47d9-8a1c-e08111f0f331 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:42.789669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 412/836] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:47:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:42.795143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:42.873930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:42.909557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff6d84-3061-4fbc-b2a5-686bdcecf066 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:42.921596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e4bd-5b81-4177-a1e3-7d4d895a7c59 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:42.922218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e4bd-5b81-4177-a1e3-7d4d895a7c59 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:42.922710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e4bd-5b81-4177-a1e3-7d4d895a7c59 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:42.924602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 413/837] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:42.931150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17902d-3a27-40fd-9f01-511eec5823ec None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:42.931759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17902d-3a27-40fd-9f01-511eec5823ec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:42.932277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17902d-3a27-40fd-9f01-511eec5823ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:42.951100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:42.951670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6e17902d-3a27-40fd-9f01-511eec5823ec None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:42.951918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:42.952237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:42.952518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:42.953871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6e17902d-3a27-40fd-9f01-511eec5823ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:42.964962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:42.966641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:42.985746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:42.986719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:42.987609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:42.987609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:42.987609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:42.987609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:42.987609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 425/838] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:42.993779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.044092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 414/839] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:47:43.066851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17902d-3a27-40fd-9f01-511eec5823ec None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.115548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637cf82-1f0e-454d-b93a-f4a8e8166bd5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.142102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:43.156098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca9e2-a01f-4799-9280-a01677b393a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.156780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca9e2-a01f-4799-9280-a01677b393a8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.157071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca9e2-a01f-4799-9280-a01677b393a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.157346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca9e2-a01f-4799-9280-a01677b393a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.158084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca9e2-a01f-4799-9280-a01677b393a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:43.158536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca9e2-a01f-4799-9280-a01677b393a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.159761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca9e2-a01f-4799-9280-a01677b393a8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.172982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 426/840] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:43.174502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974b48-87d9-4db3-aef4-bbad1ef6bf0c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.174871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974b48-87d9-4db3-aef4-bbad1ef6bf0c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.175228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974b48-87d9-4db3-aef4-bbad1ef6bf0c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.176738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 427/841] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:43.182215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974b48-87d9-4db3-aef4-bbad1ef6bf0c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.185801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17902d-3a27-40fd-9f01-511eec5823ec None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.196435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:43.222922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f656a-9c9c-41d6-a987-77b721a78ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.223997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f656a-9c9c-41d6-a987-77b721a78ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.223997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f656a-9c9c-41d6-a987-77b721a78ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.224913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f656a-9c9c-41d6-a987-77b721a78ec1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.235206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f656a-9c9c-41d6-a987-77b721a78ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f15f656a-9c9c-41d6-a987-77b721a78ec1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:43.243511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:43.244491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:43.245389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 415/842] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:43.246094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907665e-edb1-4e6d-b5df-c4b3083cb819 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.246774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907665e-edb1-4e6d-b5df-c4b3083cb819 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.246774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907665e-edb1-4e6d-b5df-c4b3083cb819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.263577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2907665e-edb1-4e6d-b5df-c4b3083cb819 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:43.264807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2907665e-edb1-4e6d-b5df-c4b3083cb819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:43.304335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974b48-87d9-4db3-aef4-bbad1ef6bf0c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.341383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.342199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.342483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.342798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.344489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 416/843] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:43.351025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.352503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.353220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907665e-edb1-4e6d-b5df-c4b3083cb819 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:43.369292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:43.370309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:43.371259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 428/844] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:43.372646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.421550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:43.470042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:43.476515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907665e-edb1-4e6d-b5df-c4b3083cb819 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.483500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0017b9-226a-4a0e-8006-e1c9577afc25 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.519225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.519436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.519903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.520339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.520448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.520614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.520714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.520872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.522075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.522556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:43.522869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.523457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.524487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.538842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 417/845] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:43.538842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:43.539119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:43.541009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:43.541866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 429/846] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:43.544545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.651741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab2fac-ae92-4d16-b284-26913738bca4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.651969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1bdb6-0f66-463b-b1b7-57acddedd4b2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.662638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:43.688482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.689077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.689365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.689658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.690372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:43.690686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.692079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.693458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.694141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.694431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.694704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.695554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:43.695870 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.697353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.698138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 430/847] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:43.698866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.720952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 418/848] 10.222.0.69 () {56 vars in 1149 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:43.722276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.745536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:43.816981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5fb5-af99-4be7-a306-62de253fbd7e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.848454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19350a-b4da-47cf-bb06-813d1030ffb5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:43.854123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.854958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.855249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.855528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.867415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.868904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.886519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:43.887194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:43.887397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:43.888289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:43.889185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:43.889185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:43.889185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:43.889185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:43.889403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:43.889403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:43.889403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:43.889619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 431/849] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:43.890106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.893639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:43.895313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:43.908847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 419/850] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:43.908847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:43.932076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.030214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.031872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cbc9e-557d-4cb2-bb62-4dd18af251e9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.054882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31f2d5-1ab4-45a1-94fc-8cedc5e12721 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.074953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07951e6e-678d-4190-9593-b7369cd022cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.075772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951e6e-678d-4190-9593-b7369cd022cc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.076200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951e6e-678d-4190-9593-b7369cd022cc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.076681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07951e6e-678d-4190-9593-b7369cd022cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.097339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.098022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.098305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.098582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.099927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:44.100274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.101708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.118830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 420/851] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:44.120235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.155164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07951e6e-678d-4190-9593-b7369cd022cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.156671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07951e6e-678d-4190-9593-b7369cd022cc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.182411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.235965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42851a-075d-4a4a-907e-2bbb9e3a0cf0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.261452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 432/852] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:47:44.262801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aad49-89f3-42bf-9a87-94e122b5c5da None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.263097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aad49-89f3-42bf-9a87-94e122b5c5da None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.263380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aad49-89f3-42bf-9a87-94e122b5c5da None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.264824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 433/853] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:44.266763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1aad49-89f3-42bf-9a87-94e122b5c5da None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.282604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097230d-1dfd-4f97-a654-b3f23358c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.283453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097230d-1dfd-4f97-a654-b3f23358c783 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.283884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097230d-1dfd-4f97-a654-b3f23358c783 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.284203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097230d-1dfd-4f97-a654-b3f23358c783 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.293372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097230d-1dfd-4f97-a654-b3f23358c783 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.295082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097230d-1dfd-4f97-a654-b3f23358c783 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c097230d-1dfd-4f97-a654-b3f23358c783 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:44.310205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:44.311215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:44.312207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 421/854] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:44.313319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e62b0-e892-45cd-8722-6265f82cf423 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.313319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e62b0-e892-45cd-8722-6265f82cf423 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.313481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e62b0-e892-45cd-8722-6265f82cf423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.319386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.334028 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-134e62b0-e892-45cd-8722-6265f82cf423 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:44.335312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-134e62b0-e892-45cd-8722-6265f82cf423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:44.382082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1aad49-89f3-42bf-9a87-94e122b5c5da None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.407297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.407766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 422/855] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:44.408642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e62b0-e892-45cd-8722-6265f82cf423 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.426756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.428268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.429025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.429511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.442134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.444117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:44.463211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:44.464227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:44.465101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:44.465101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:44.465101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:44.465101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:44.465101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 434/856] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:44.465816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.525576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e62b0-e892-45cd-8722-6265f82cf423 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.556112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.563344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.564033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.564326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.564595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.565426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:44.565736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.567164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.576084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d305cff-b7a9-4e3d-bfbf-6511f95b3e2b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.586421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 423/857] 10.222.0.69 () {56 vars in 1135 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:44.587087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.618335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.619152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.619438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.619717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.620444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.621774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:44.634602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:44.635608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:44.636486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 435/858] 10.222.0.69 () {56 vars in 1132 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:44.637347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.681598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.700304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f62d2-1607-46cd-8fc3-560cdafd55e7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.739379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.740836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.741132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.741414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.742151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:44.742466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.743875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.756842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d37b22-a410-4bfa-8ea0-8d5fa4bc8640 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.762511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 424/859] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:44.762511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.794315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.794976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.795261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.795543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.816758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.870027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.871269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.872982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33271-2e5f-4851-aa42-55cc5fc301a0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:44.910557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:44.911225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:44.911532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:44.912429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:44.913270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:44.913588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:44.915274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:44.915928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:44.926405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 425/860] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:44.926405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:44.986065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 436/861] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:47:44.986065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:45.034271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8d26d-30fa-40f1-b787-66f9b8a64913 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.049202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:45.073464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.074187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.074476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.074749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.081736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.083198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.097107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097e9d-7f72-47ff-ac17-9118b61c2bba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:45.097783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:45.098662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 426/862] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:45.100350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:45.142578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.143256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.143542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.143817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.144564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:45.144877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.146568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.152056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 437/863] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:45.153147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:45.157107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:45.236218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e754662-205f-4cf8-b56d-9418a1129084 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.286859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.287954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.288282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.288564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.290671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77095b85-4916-4333-bd9a-b79f30b75df2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.302387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.304577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:45.329477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:45.330408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:45.331297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:45.331297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:45.331297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:45.331297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:45.334342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.335423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.335949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.336319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 427/864] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:45.336691 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.337634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:45.338080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:45.338786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.340573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.354690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 438/865] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:45.361182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:45.370447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:45.450748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:45.458650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03ade-c8d9-49d4-a7cd-7e269d4282fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.496436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.497439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.497911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.498366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.499301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:45.499805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.501590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.501949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75989b-1a72-4edd-930a-878e8942761f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.514656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 428/866] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:45.526524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:45.557648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.558718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.559271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.559556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.560436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=5927394f6adf4fd0b85d6cdeeec358b6) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:45.560756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.563393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.576212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 439/867] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:45 2022] GET /identity/v3/role_assignments?user.id=5927394f6adf4fd0b85d6cdeeec358b6&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:45.633513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:45.652705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86f241-e313-4e0a-a20c-591575d891df None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.701950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.702925 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.703287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.703575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.712624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.714144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:45.731791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:45.732796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:45.733695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 429/868] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:45.739126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:45.865791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6c9b-435c-4647-96e3-01ea0f69b4dd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:45.893337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:45.903265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635069d-cf50-48b4-81ca-3b6ad4b3e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:45.903947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635069d-cf50-48b4-81ca-3b6ad4b3e23b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:45.904267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635069d-cf50-48b4-81ca-3b6ad4b3e23b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:45.904549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635069d-cf50-48b4-81ca-3b6ad4b3e23b None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:45.905355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635069d-cf50-48b4-81ca-3b6ad4b3e23b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:45.905668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635069d-cf50-48b4-81ca-3b6ad4b3e23b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:45.907116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635069d-cf50-48b4-81ca-3b6ad4b3e23b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:45.924103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 440/869] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:45.927761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:46.047059 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1f52-9243-48ce-bcad-9dffb20034f7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:46.086047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbab92-00ee-4682-af71-b117a5ce6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:46.087075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbab92-00ee-4682-af71-b117a5ce6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:46.087565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbab92-00ee-4682-af71-b117a5ce6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:46.088089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbab92-00ee-4682-af71-b117a5ce6ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:46.089122 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbab92-00ee-4682-af71-b117a5ce6ca9 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=0dc7da9d33b941dc91a98c8adbb545d9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:46.089631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbab92-00ee-4682-af71-b117a5ce6ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:46.091258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbab92-00ee-4682-af71-b117a5ce6ca9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:46.098455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 430/870] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:45 2022] GET /identity/v3/role_assignments?user.id=0dc7da9d33b941dc91a98c8adbb545d9&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:46.206973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0bf48-eb55-4b69-b5f2-bd96fa870af8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:46.207313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0bf48-eb55-4b69-b5f2-bd96fa870af8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:46.207543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0bf48-eb55-4b69-b5f2-bd96fa870af8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:46.209583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 441/871] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:46.215697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac01a-1874-4282-b0f7-324570e60872 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:46.216066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac01a-1874-4282-b0f7-324570e60872 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:46.216305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac01a-1874-4282-b0f7-324570e60872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:46.234533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-617ac01a-1874-4282-b0f7-324570e60872 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:46.235761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-617ac01a-1874-4282-b0f7-324570e60872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:46.240855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:46.317830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 431/872] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:46.342519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0bf48-eb55-4b69-b5f2-bd96fa870af8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:46.457493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0bf48-eb55-4b69-b5f2-bd96fa870af8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:46.495829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6933c-4cd2-4722-9204-c0a9e945e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:46.496540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6933c-4cd2-4722-9204-c0a9e945e73d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:46.496831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6933c-4cd2-4722-9204-c0a9e945e73d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:46.497113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6933c-4cd2-4722-9204-c0a9e945e73d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:46.497857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6933c-4cd2-4722-9204-c0a9e945e73d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:46.499228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6933c-4cd2-4722-9204-c0a9e945e73d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:46.515362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 442/873] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:47:46 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:47.507316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19193a-bafc-4884-8fb6-5af350df5967 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:47.507876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19193a-bafc-4884-8fb6-5af350df5967 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:47.507876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19193a-bafc-4884-8fb6-5af350df5967 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:47.509520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 432/874] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:47.515002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e4d3-d7d0-472e-9c95-d6b01b28691c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:47.515437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e4d3-d7d0-472e-9c95-d6b01b28691c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:47.515609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e4d3-d7d0-472e-9c95-d6b01b28691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:47.533526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-20b0e4d3-d7d0-472e-9c95-d6b01b28691c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:47.534726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-20b0e4d3-d7d0-472e-9c95-d6b01b28691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:47.581742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:47.615256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 443/875] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:47.638293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19193a-bafc-4884-8fb6-5af350df5967 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:47.748227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19193a-bafc-4884-8fb6-5af350df5967 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:47.785441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7656e1-6b64-4970-a5e1-498a1dcbc319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:47.786041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7656e1-6b64-4970-a5e1-498a1dcbc319 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:47.786358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7656e1-6b64-4970-a5e1-498a1dcbc319 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:47.786673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7656e1-6b64-4970-a5e1-498a1dcbc319 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:47.787429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7656e1-6b64-4970-a5e1-498a1dcbc319 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:47.788858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7656e1-6b64-4970-a5e1-498a1dcbc319 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:47.801328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:47.809143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 433/876] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:47:47 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:48.093495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff8b1-ddd0-4bfc-ae17-df9b3f547418 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.093960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff8b1-ddd0-4bfc-ae17-df9b3f547418 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.094353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff8b1-ddd0-4bfc-ae17-df9b3f547418 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.096101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 444/877] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:48.102184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c07c1-9967-41aa-8a40-2bf0d30342bf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.102596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c07c1-9967-41aa-8a40-2bf0d30342bf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.102985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c07c1-9967-41aa-8a40-2bf0d30342bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.121169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-af5c07c1-9967-41aa-8a40-2bf0d30342bf None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:48.122446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-af5c07c1-9967-41aa-8a40-2bf0d30342bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:48.201730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 434/878] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:48.225983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceff8b1-ddd0-4bfc-ae17-df9b3f547418 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:48.335518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceff8b1-ddd0-4bfc-ae17-df9b3f547418 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:48.376048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:48.377205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.377710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.378209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.390634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:48.399865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:48.400835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:47:48.401683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:48.404526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 445/879] 10.222.0.69 () {56 vars in 1120 bytes} [Thu May 26 17:47:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:48.412410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c07c1-9967-41aa-8a40-2bf0d30342bf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:48.518160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c07c1-9967-41aa-8a40-2bf0d30342bf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:48.548133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:48.558445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118d56-e814-4445-8c9d-257f7410dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:48.559141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118d56-e814-4445-8c9d-257f7410dee8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.559430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118d56-e814-4445-8c9d-257f7410dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.559710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118d56-e814-4445-8c9d-257f7410dee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.560537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118d56-e814-4445-8c9d-257f7410dee8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:48.560852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118d56-e814-4445-8c9d-257f7410dee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:48.562272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118d56-e814-4445-8c9d-257f7410dee8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:48.576444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 435/880] 10.222.0.69 () {56 vars in 1115 bytes} [Thu May 26 17:47:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:48.581142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:48.620536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:48.742041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7ef7-d32d-4afe-91f9-aedfb45f88bf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:48.788515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97d343-68e4-4326-9a92-7d51854745f7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.789460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97d343-68e4-4326-9a92-7d51854745f7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.789961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97d343-68e4-4326-9a92-7d51854745f7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.792573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 436/881] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:48.797987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1dc5-4f4d-44ac-aaf2-c7bad2efe12a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.798363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1dc5-4f4d-44ac-aaf2-c7bad2efe12a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.798717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1dc5-4f4d-44ac-aaf2-c7bad2efe12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.803446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:48.804362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.804651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.804932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.818499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3e7e1dc5-4f4d-44ac-aaf2-c7bad2efe12a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:48.819790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:48.820286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e7e1dc5-4f4d-44ac-aaf2-c7bad2efe12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:48.821319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:48.843784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:48.844780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:48.846063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:48.846063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:48.846063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:48.846063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:48.846063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 446/882] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:48.851111 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:48.908117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 437/883] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:47:48.925995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1dc5-4f4d-44ac-aaf2-c7bad2efe12a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:48.940686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:48.957386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb456ca-0858-4083-91ef-ee4069f67e95 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:48.994414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a143e-3ae1-4a37-a325-6cf75abe7606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:48.995010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a143e-3ae1-4a37-a325-6cf75abe7606 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:48.995295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a143e-3ae1-4a37-a325-6cf75abe7606 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:48.995580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a143e-3ae1-4a37-a325-6cf75abe7606 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:48.996341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a143e-3ae1-4a37-a325-6cf75abe7606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:48.996655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a143e-3ae1-4a37-a325-6cf75abe7606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:48.998037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a143e-3ae1-4a37-a325-6cf75abe7606 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.010424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 447/884] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:49.011736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4637-7037-4280-ab1d-be1e9ebea302 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.012047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4637-7037-4280-ab1d-be1e9ebea302 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.012362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4637-7037-4280-ab1d-be1e9ebea302 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.013878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 448/885] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:49.015644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb4637-7037-4280-ab1d-be1e9ebea302 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.045358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1dc5-4f4d-44ac-aaf2-c7bad2efe12a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.063678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:49.083216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb302fc8-7574-4b6d-bcfb-c7d91c9f9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.084673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb302fc8-7574-4b6d-bcfb-c7d91c9f9192 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.084941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb302fc8-7574-4b6d-bcfb-c7d91c9f9192 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.085229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb302fc8-7574-4b6d-bcfb-c7d91c9f9192 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.085896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb302fc8-7574-4b6d-bcfb-c7d91c9f9192 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.087289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb302fc8-7574-4b6d-bcfb-c7d91c9f9192 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-fb302fc8-7574-4b6d-bcfb-c7d91c9f9192 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:49.099867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:49.100956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:49.101785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 438/886] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:49.102590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5d31d-5a90-45f6-9f0f-4592350faeb0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.102590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5d31d-5a90-45f6-9f0f-4592350faeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.103392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5d31d-5a90-45f6-9f0f-4592350faeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.119419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-19e5d31d-5a90-45f6-9f0f-4592350faeb0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:49.120661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-19e5d31d-5a90-45f6-9f0f-4592350faeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:49.134813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb4637-7037-4280-ab1d-be1e9ebea302 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.170969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.171791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.172090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.172374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.179768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.181265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.190461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 439/887] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:49.191496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5d31d-5a90-45f6-9f0f-4592350faeb0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:49.196791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:49.197712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:49.198636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:49.202687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 449/888] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:49.203543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.213032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:49.308355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5d31d-5a90-45f6-9f0f-4592350faeb0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.310706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34a15-b827-4f0e-8437-55ff12c51b4e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.322455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:49.345406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.346076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.346364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.346647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.347409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:49.347678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.349800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.350604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.351284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.351573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.351856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.352733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:49.353047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.354464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.355240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 440/889] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:49.360711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.377418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 450/890] 10.222.0.69 () {56 vars in 1149 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:49.377418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.455151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:49.468581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ab2cd-988b-4965-9fad-879890a1f097 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.498827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0661012-1db5-4e07-88d4-31a7b6474be2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.505375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.506196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.506480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.506761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.507430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.508845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:49.523421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:49.525102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:49.525919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 441/891] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:49.526722 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.542865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.543791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.544135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.544429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.545462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:49.545462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.546794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.560141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 451/892] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:49.560141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.586269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:49.670957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ee41f-a578-4e6f-9bf9-db0c8ae03aba None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.699388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5307c-50c9-47bd-8b0b-c539df13191f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.721658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.722644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.723143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.723747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.731328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:49.741557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.742241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.742533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.742818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.743565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:49.743879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.745322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.751196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 452/893] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:49.757262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.829471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.831635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.876701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a36e-c0f6-4ab1-860d-e17211fd04b1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:49.888476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:49.933558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:49.934497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:49.935485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:49.935872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:49.937172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:49.937857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:49.939623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:49.948107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 453/894] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:49.953043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:49.971578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 442/895] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:47:49.977508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.025219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:50.087585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944b48-fe7d-4f03-819d-f4a6b5876360 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.099789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4a99-5743-46c7-b138-91bd7a511a6c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.126973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61cb1-3e02-4bbd-bc1a-aba91af15b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.127594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61cb1-3e02-4bbd-bc1a-aba91af15b29 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.127884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61cb1-3e02-4bbd-bc1a-aba91af15b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.128206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61cb1-3e02-4bbd-bc1a-aba91af15b29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.129015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61cb1-3e02-4bbd-bc1a-aba91af15b29 None admin] RBAC: Adding query filter params (interface=public, service_id=2892e8d87aa3483fa12cb7e74f12f528, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:50.129477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61cb1-3e02-4bbd-bc1a-aba91af15b29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.130746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61cb1-3e02-4bbd-bc1a-aba91af15b29 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.137696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abaffb-c354-4666-896c-3f76ec784d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.138494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abaffb-c354-4666-896c-3f76ec784d92 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.138890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 454/896] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/endpoints?service_id=2892e8d87aa3483fa12cb7e74f12f528&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:50.140311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037285-5c6b-40f8-bb32-673cf99f92f6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.140540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abaffb-c354-4666-896c-3f76ec784d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.140643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037285-5c6b-40f8-bb32-673cf99f92f6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.140875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037285-5c6b-40f8-bb32-673cf99f92f6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.141327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abaffb-c354-4666-896c-3f76ec784d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.142371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 455/897] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:50.143844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037285-5c6b-40f8-bb32-673cf99f92f6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.155922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:50.159005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abaffb-c354-4666-896c-3f76ec784d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.161057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abaffb-c354-4666-896c-3f76ec784d92 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-11abaffb-c354-4666-896c-3f76ec784d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:50.180634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:50.181687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:50.182567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:50.182567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:50.182567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:50.182567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:50.182567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 443/898] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:50.183335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdbd26-e8bc-4464-b8be-96a7a82b1603 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.183335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdbd26-e8bc-4464-b8be-96a7a82b1603 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.183608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdbd26-e8bc-4464-b8be-96a7a82b1603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.202003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-28fdbd26-e8bc-4464-b8be-96a7a82b1603 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:50.203253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28fdbd26-e8bc-4464-b8be-96a7a82b1603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:50.261463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037285-5c6b-40f8-bb32-673cf99f92f6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.285062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:50.296189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 444/899] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:50.297222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdbd26-e8bc-4464-b8be-96a7a82b1603 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.300488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.301351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.302394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.302882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.303808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.305511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.312131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 456/900] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:47:50.313154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.448415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdbd26-e8bc-4464-b8be-96a7a82b1603 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.459589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fe757-cf66-462d-9918-0772105f8bea None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.477309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:50.491964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.492727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.493020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.493299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.494043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:50.494354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.495781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.514108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 445/901] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:50.514989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.515752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.516382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.516886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.517170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.517848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.519461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:50.534686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:50.535644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:50.536566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:50.540148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 457/902] 10.222.0.69 () {56 vars in 1132 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:50.543373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.608072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:50.653910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee384-a2de-4bb3-bb56-f27ed453edda None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.673528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d149-df62-4093-998f-2b538ad25858 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.699108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.700546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.701240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.701627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.712601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.714394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.716844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.717134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.717411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.718560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:50.718874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.720265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.731059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 458/903] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:50.732351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:50.733224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:50.734114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:50.734550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.734627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 446/904] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:50.742703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.816044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:50.865413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e0b00-33fa-4a69-85eb-748dcd6eb4e8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.880183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:50.887912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceba57-2153-49b7-a811-b71904059aad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:50.906666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.907455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.907747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.908044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.908781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:50.909095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.910683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.917573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 459/905] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:50.923024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:50.932061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:50.932738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:50.933024 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:50.933307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:50.934239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:50.934554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:50.936001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:50.949439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 447/906] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:50.956123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:51.060078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e96fca-af74-4aef-a536-d13b58fd340c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:51.097167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e429-7357-4e8f-bd4c-bc9bc65b2dbc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:51.099899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:51.104310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:51.104985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:51.105275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:51.105557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:51.106365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] RBAC: Adding query filter params (interface=public, service_id=70a2112d5ca9458391a606cb45c19645, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:51.106685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:51.108091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:51.115069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 460/907] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/endpoints?service_id=70a2112d5ca9458391a606cb45c19645&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:51.120633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:51.146148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1cfe4-5934-4284-baf8-91cea7d3a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:51.147176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1cfe4-5934-4284-baf8-91cea7d3a69a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:51.147666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1cfe4-5934-4284-baf8-91cea7d3a69a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:51.148389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1cfe4-5934-4284-baf8-91cea7d3a69a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:51.149257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1cfe4-5934-4284-baf8-91cea7d3a69a None admin] RBAC: Adding query filter params (role.id=b272da8c4bef43fda8c9ebce7f48e128, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=5927394f6adf4fd0b85d6cdeeec358b6) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:51.149578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1cfe4-5934-4284-baf8-91cea7d3a69a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:51.151034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1cfe4-5934-4284-baf8-91cea7d3a69a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:51.159884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 448/908] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:47:50 2022] GET /identity/v3/role_assignments?user.id=5927394f6adf4fd0b85d6cdeeec358b6&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=b272da8c4bef43fda8c9ebce7f48e128 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:51.189767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:51.259440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cc730-37af-4262-8d32-84367cc6c52b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:51.297753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a45a4-07a6-46dd-aa6c-f0bb3afc23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:51.298440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a45a4-07a6-46dd-aa6c-f0bb3afc23ba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:51.298732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a45a4-07a6-46dd-aa6c-f0bb3afc23ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:51.299016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a45a4-07a6-46dd-aa6c-f0bb3afc23ba None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:51.299724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a45a4-07a6-46dd-aa6c-f0bb3afc23ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:51.301155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a45a4-07a6-46dd-aa6c-f0bb3afc23ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:51.308781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 461/909] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:47:51 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:47:51.917723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a230-062a-4bfe-9f70-9991e1e838b1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:51.918259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a230-062a-4bfe-9f70-9991e1e838b1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:51.918259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a230-062a-4bfe-9f70-9991e1e838b1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:51.919902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 449/910] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:51.925526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cab88-9873-42b6-a360-cc37fcf9e64d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:51.925975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cab88-9873-42b6-a360-cc37fcf9e64d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:51.926156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cab88-9873-42b6-a360-cc37fcf9e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:51.944202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7f0cab88-9873-42b6-a360-cc37fcf9e64d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:51.945415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7f0cab88-9873-42b6-a360-cc37fcf9e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:52.020721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 462/911] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:52.043630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7a230-062a-4bfe-9f70-9991e1e838b1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:52.151917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7a230-062a-4bfe-9f70-9991e1e838b1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:52.187825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89198744-34de-4bdf-8833-b07db63e0261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:52.188535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198744-34de-4bdf-8833-b07db63e0261 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:52.188825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198744-34de-4bdf-8833-b07db63e0261 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:52.189107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198744-34de-4bdf-8833-b07db63e0261 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:52.189936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89198744-34de-4bdf-8833-b07db63e0261 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:52.191322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89198744-34de-4bdf-8833-b07db63e0261 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:52.208154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 450/912] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:47:52 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:52.672553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b24f-9ada-4a5e-8db8-5c262388bc8b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:52.672893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b24f-9ada-4a5e-8db8-5c262388bc8b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:52.673132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b24f-9ada-4a5e-8db8-5c262388bc8b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:52.674738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 463/913] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:52.680253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1110fcd-29e3-4fc6-aef4-641de4773ac8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:52.680554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1110fcd-29e3-4fc6-aef4-641de4773ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:52.680838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1110fcd-29e3-4fc6-aef4-641de4773ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:52.698697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a1110fcd-29e3-4fc6-aef4-641de4773ac8 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:52.699890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1110fcd-29e3-4fc6-aef4-641de4773ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:52.721083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:52.779829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 451/914] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:52.804757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9b24f-9ada-4a5e-8db8-5c262388bc8b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:52.843542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:52.914073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9b24f-9ada-4a5e-8db8-5c262388bc8b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:52.950718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:52.951491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:52.951738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:52.952041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:52.952718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:52.954161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:52.967295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:52.968389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:52.969211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 464/915] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:52.975258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1110fcd-29e3-4fc6-aef4-641de4773ac8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:53.089883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1110fcd-29e3-4fc6-aef4-641de4773ac8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:53.128181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:53.128868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.129156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.129439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.130236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:53.130548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:53.131958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:53.137807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 452/916] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:53.143434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:53.249504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:53.253281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b82fa-ccbb-40a3-98dd-a2ba518d049a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:53.290301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc1884-becf-443f-af9a-6776c0ec2d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:53.290999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc1884-becf-443f-af9a-6776c0ec2d83 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.291289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc1884-becf-443f-af9a-6776c0ec2d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.291570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc1884-becf-443f-af9a-6776c0ec2d83 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.292348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc1884-becf-443f-af9a-6776c0ec2d83 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:53.292665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc1884-becf-443f-af9a-6776c0ec2d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:53.294091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc1884-becf-443f-af9a-6776c0ec2d83 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:53.300486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 465/917] 10.222.0.69 () {56 vars in 1114 bytes} [Thu May 26 17:47:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:53.307333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:53.329736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:53.430779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c15b3-3071-48d7-8aa5-5a753abae1db None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:53.470915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c020-d08b-407b-b9b6-b62a40655796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:53.471585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c020-d08b-407b-b9b6-b62a40655796 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.471868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c020-d08b-407b-b9b6-b62a40655796 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.472175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c020-d08b-407b-b9b6-b62a40655796 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.472940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c020-d08b-407b-b9b6-b62a40655796 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:53.474856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c020-d08b-407b-b9b6-b62a40655796 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:53.497436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 453/918] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:47:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:53.515550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c376c-e2c5-4128-877f-116b1a83636f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.515550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c376c-e2c5-4128-877f-116b1a83636f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.515550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c376c-e2c5-4128-877f-116b1a83636f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.515550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 466/919] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:53.522740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c5a5-73b8-40cd-9621-27a7212f7277 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.523193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c5a5-73b8-40cd-9621-27a7212f7277 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.523579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c5a5-73b8-40cd-9621-27a7212f7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.545209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dc88c5a5-73b8-40cd-9621-27a7212f7277 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:53.546485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dc88c5a5-73b8-40cd-9621-27a7212f7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:53.609513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda7a7-1a4d-47f0-b0e8-fc885ff424b8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.609790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda7a7-1a4d-47f0-b0e8-fc885ff424b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.610083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda7a7-1a4d-47f0-b0e8-fc885ff424b8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.611757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 467/920] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:53.622438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c98f-4663-4242-9269-de43098bce45 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.623361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c98f-4663-4242-9269-de43098bce45 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.623989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c98f-4663-4242-9269-de43098bce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.635459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:53.644526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 454/921] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:53.653105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6af1c98f-4663-4242-9269-de43098bce45 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:53.654478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6af1c98f-4663-4242-9269-de43098bce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:53.677773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88c5a5-73b8-40cd-9621-27a7212f7277 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:53.750975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 468/922] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:53.774664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c98f-4663-4242-9269-de43098bce45 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:53.827150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88c5a5-73b8-40cd-9621-27a7212f7277 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:53.876007 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:53.877540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.878242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.878673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.882289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:53.890818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c98f-4663-4242-9269-de43098bce45 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:53.895231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:53.905426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:53.906588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:47:53.907583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:53.910691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 455/923] 10.222.0.69 () {56 vars in 1120 bytes} [Thu May 26 17:47:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:53.916841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:53.932355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:53.933562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:53.934184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:53.934690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:53.935658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:53.937344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:53.952630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:53.954121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:47:53.954945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:53.962885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 469/924] 10.222.0.69 () {56 vars in 1132 bytes} [Thu May 26 17:47:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:53.965074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:53.984847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:54.048255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea921e-d875-4592-93e4-0acd44280142 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.077552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8d7a0-5bcc-4385-a077-6a630366b6ed None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.091869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.092572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.092857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.093460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.094324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:54.094642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.096070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.106704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 456/925] 10.222.0.69 () {56 vars in 1115 bytes} [Thu May 26 17:47:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:54.112291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:54.118927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.120457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.121220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.121957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.123300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:54.124738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.126095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.135795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 470/926] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:54.137138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:54.165961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:54.247352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ee88-9c21-4d88-b7e2-89b8e028993c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.261091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61103-6169-4a13-8a81-c643030b7b54 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.272285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:54.288212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.289353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.289569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.289950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.300897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.302378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.302546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.302950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.303471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.304364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.304533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:54.304974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.306483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.312555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 471/927] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:54.318361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:54.331741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:54.332716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:54.333799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:54.333799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:54.333799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:54.333799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:54.341430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 457/928] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:54.343128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:54.447305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:54.459538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d34a3-fb05-47df-a3ca-b820323a0315 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.476518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02ba2-bae3-4fe4-9f52-edd26a618997 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.496375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.497046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.497326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.497604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.498339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:54.498645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.500249 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.517577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 458/929] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:54.518934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:54.527586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022ac42-e7c0-4099-af1a-06e7888896d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.528305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022ac42-e7c0-4099-af1a-06e7888896d9 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.528594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022ac42-e7c0-4099-af1a-06e7888896d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.528874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022ac42-e7c0-4099-af1a-06e7888896d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.529627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022ac42-e7c0-4099-af1a-06e7888896d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.531016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022ac42-e7c0-4099-af1a-06e7888896d9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.560174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 472/930] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:47:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:47:54.575876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:54.600240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca9e7-fdf2-48a5-b883-afa4910f64c4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.600590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca9e7-fdf2-48a5-b883-afa4910f64c4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.600819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca9e7-fdf2-48a5-b883-afa4910f64c4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.602548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 473/931] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:54.609047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763ae0-d668-422b-bca9-febb820ef33b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.609384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763ae0-d668-422b-bca9-febb820ef33b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.609627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763ae0-d668-422b-bca9-febb820ef33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.628400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ef763ae0-d668-422b-bca9-febb820ef33b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:54.629705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ef763ae0-d668-422b-bca9-febb820ef33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:54.665844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed4ce-572d-417d-922a-0b569dfa3e15 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.722138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.724783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.725574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.726120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.732196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 474/932] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:54.739143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.741384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.752229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef763ae0-d668-422b-bca9-febb820ef33b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:54.760818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:54.761857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:54.762793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:54.765777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 459/933] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:47:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:54.773137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:54.845920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:54.905331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef763ae0-d668-422b-bca9-febb820ef33b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.912471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:54.935552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696549c-af28-49a1-b2b1-65933ea00f0f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:54.964756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:54.965630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:54.966006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:54.966193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:54.966804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:54.968228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:54.981947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:54.984055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:54.985741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 475/934] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:54.997767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.006750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.007561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.007973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.008353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.009341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:55.009727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.011276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.038819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 460/935] 10.222.0.69 () {56 vars in 1149 bytes} [Thu May 26 17:47:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:55.040043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.142875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583410c3-9024-4364-8417-d77044c43c14 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.188681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998851-cabb-4c34-a6ad-668085f3dc78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.189807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a280-e404-454d-af88-a07addceda70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.190735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a280-e404-454d-af88-a07addceda70 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.191243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a280-e404-454d-af88-a07addceda70 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.191721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a280-e404-454d-af88-a07addceda70 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.193463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612a280-e404-454d-af88-a07addceda70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:55.194009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612a280-e404-454d-af88-a07addceda70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.195606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612a280-e404-454d-af88-a07addceda70 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.197503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:55.202676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 476/936] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:47:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:55.212556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a280-e404-454d-af88-a07addceda70 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.248257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.248922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.249213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.249512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.263723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.265267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.274989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:55.291097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:55.292092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:55.292985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:55.292985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:55.292985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:55.292985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:55.297022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 461/937] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:55.299003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.344935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a280-e404-454d-af88-a07addceda70 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.399515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.400213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.400503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.400787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.401564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:55.401884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.403267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.414276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 477/938] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:47:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:55.415583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.442800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2eb54-9914-4981-93c9-59db0aee25de None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.490694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.491594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.491984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.492397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.493367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:55.494087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.495414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.496794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:55.516477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 462/939] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:55.521066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.552776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206d1ea-7534-4b2f-b8e4-ca1afc029927 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.598912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.599598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.599887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.600251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.601077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] RBAC: Adding query filter params (interface=public, service_id=c70e0f57af2e49e49fc58a4785a2739f, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:55.601448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.602875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.613066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 478/940] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:47:55 2022] GET /identity/v3/endpoints?service_id=c70e0f57af2e49e49fc58a4785a2739f&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:55.614595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.619805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:55.681842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca260e-244d-4ed7-948f-dbb81f21ea03 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.734287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.735652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.736536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.736973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.739301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129850c-1f3d-4b9d-904d-f3bd34683599 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.746702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.749209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.774049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:55.774940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:55.775916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:55.776825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:55.784256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 463/941] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:55.786760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:55.793062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.794032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.794526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.795010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.796502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.798602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.816774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 479/942] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:47:55 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:47:55.921620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1c536-8429-4bb4-a794-0801b2617a20 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:55.943758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:55.963842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1ca25-e91a-46ce-9cd2-80bf7631d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:55.964971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ca25-e91a-46ce-9cd2-80bf7631d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:55.965468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ca25-e91a-46ce-9cd2-80bf7631d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:55.965953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ca25-e91a-46ce-9cd2-80bf7631d8e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:55.966998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ca25-e91a-46ce-9cd2-80bf7631d8e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:55.967529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ca25-e91a-46ce-9cd2-80bf7631d8e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:55.969309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ca25-e91a-46ce-9cd2-80bf7631d8e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:55.983783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 464/943] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:55.990698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:56.022244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac98be-5e40-4966-94f2-ef2f14f8cacc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:56.022780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac98be-5e40-4966-94f2-ef2f14f8cacc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:56.022780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac98be-5e40-4966-94f2-ef2f14f8cacc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:56.024433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 465/944] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:56.030110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d27c-e15c-42d5-8e99-2392faf64b8a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:56.030399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d27c-e15c-42d5-8e99-2392faf64b8a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:56.030681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d27c-e15c-42d5-8e99-2392faf64b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:56.050265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4531d27c-e15c-42d5-8e99-2392faf64b8a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:56.052655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4531d27c-e15c-42d5-8e99-2392faf64b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:56.122240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea2203-a3fb-4b11-b060-c58720f317fb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:56.157353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 466/945] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:47:56.164071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:56.164071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:56.164071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:56.164071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/5927394f6adf4fd0b85d6cdeeec358b6/roles/b272da8c4bef43fda8c9ebce7f48e128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:56.165139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=5927394f6adf4fd0b85d6cdeeec358b6, role_id=b272da8c4bef43fda8c9ebce7f48e128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:56.166712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:56.185880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d27c-e15c-42d5-8e99-2392faf64b8a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:56.186083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 480/946] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:47:55 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/5927394f6adf4fd0b85d6cdeeec358b6/roles/b272da8c4bef43fda8c9ebce7f48e128 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:47:56.311196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d27c-e15c-42d5-8e99-2392faf64b8a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:56.323693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:56.358318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:56.359409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:56.359881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:56.360333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:56.361211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:56.362866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:56.365163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING keystone.server.flask.common [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 17:47:56.388169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.sql.core [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 17:47:56.388169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 17:47:56.388169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [parameters: {'id': 'ce4923edf2454ab0ba0338eba0833f67', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 17:47:56.388169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80192) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ce4923edf2454ab0ba0338eba0833f67.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ce4923edf2454ab0ba0338eba0833f67. May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:47:56.406910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 17:47:56.407982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application yield resource May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.rollback() May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.force_reraise() May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise self.value May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application session.commit() May 26 17:47:56.409203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._prepare_impl() May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.flush() May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._flush(objects) May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application compat.raise_( May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application flush_context.execute() May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 17:47:56.410091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rec.execute(self) May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 17:47:56.411929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:47:56.416548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [parameters: {'id': 'ce4923edf2454ab0ba0338eba0833f67', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:56.418660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:56.420680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ce4923edf2454ab0ba0338eba0833f67. May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:56.422932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 467/947] 10.222.0.69 () {60 vars in 1140 bytes} [Thu May 26 17:47:56 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:56.424367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:56.489471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:56.560660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46daf8e-ff60-418e-9f05-60298c277a1f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:56.623548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60559490-3310-4977-b216-b0db96949694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:56.624927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60559490-3310-4977-b216-b0db96949694 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:56.625409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60559490-3310-4977-b216-b0db96949694 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:56.625887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60559490-3310-4977-b216-b0db96949694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:56.640309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60559490-3310-4977-b216-b0db96949694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:56.642423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60559490-3310-4977-b216-b0db96949694 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-60559490-3310-4977-b216-b0db96949694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:47:56.658412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:56.659365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:47:56.660286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:56.660705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 481/948] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:56.666888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:56.788848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83a58a-514c-44f6-9d1f-8441bfcc864a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:56.834280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5854b-8cce-4a72-a43c-75dafee902d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:56.835080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5854b-8cce-4a72-a43c-75dafee902d8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:56.835367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5854b-8cce-4a72-a43c-75dafee902d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:56.835646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5854b-8cce-4a72-a43c-75dafee902d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:56.836454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5854b-8cce-4a72-a43c-75dafee902d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:56.836771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5854b-8cce-4a72-a43c-75dafee902d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:56.838501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5854b-8cce-4a72-a43c-75dafee902d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:56.864932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 468/949] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:56.994364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921f10f-0bed-40a3-a6bc-84a52c4d49e7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:56.994901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921f10f-0bed-40a3-a6bc-84a52c4d49e7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:56.994901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921f10f-0bed-40a3-a6bc-84a52c4d49e7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:56.996721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 482/950] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:57.002829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b220-4aaa-4721-bb61-2676f55cc9d9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:57.003121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b220-4aaa-4721-bb61-2676f55cc9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:57.003405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b220-4aaa-4721-bb61-2676f55cc9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:57.023813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4376b220-4aaa-4721-bb61-2676f55cc9d9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:57.025546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4376b220-4aaa-4721-bb61-2676f55cc9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:57.047854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:57.107592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 469/951] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:57.131211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921f10f-0bed-40a3-a6bc-84a52c4d49e7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:57.244463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921f10f-0bed-40a3-a6bc-84a52c4d49e7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:57.256141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:57.289301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:57.290382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:57.290835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:57.291277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:57.292120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:57.293703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:57.307473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:57.308969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:47:57.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:57.316121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 483/952] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:47:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:57.318947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b220-4aaa-4721-bb61-2676f55cc9d9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:57.429330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b220-4aaa-4721-bb61-2676f55cc9d9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:57.469408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90746a-239c-4ec7-850d-07d592eb3f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:57.470317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90746a-239c-4ec7-850d-07d592eb3f85 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:57.470705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90746a-239c-4ec7-850d-07d592eb3f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:57.471079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90746a-239c-4ec7-850d-07d592eb3f85 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:57.471907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90746a-239c-4ec7-850d-07d592eb3f85 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:57.472349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90746a-239c-4ec7-850d-07d592eb3f85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:57.473887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90746a-239c-4ec7-850d-07d592eb3f85 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:57.479647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 470/953] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:57.485477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:57.595495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54f033-745a-4dfc-a9e9-376c5ee664a5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:57.632298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2402e7-fc6c-4baf-adda-0e5bf156f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:57.633006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2402e7-fc6c-4baf-adda-0e5bf156f82c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:57.633312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2402e7-fc6c-4baf-adda-0e5bf156f82c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:57.633587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2402e7-fc6c-4baf-adda-0e5bf156f82c None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:57.634336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2402e7-fc6c-4baf-adda-0e5bf156f82c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:57.634650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2402e7-fc6c-4baf-adda-0e5bf156f82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:57.636138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2402e7-fc6c-4baf-adda-0e5bf156f82c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:57.641899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 484/954] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:47:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:58.277783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5240c01-e1d1-4a87-8247-10c760797512 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.278342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5240c01-e1d1-4a87-8247-10c760797512 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.278342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5240c01-e1d1-4a87-8247-10c760797512 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.280071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 471/955] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:58.285921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2be48-c59a-4790-b2b3-5de49c687e45 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.286426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2be48-c59a-4790-b2b3-5de49c687e45 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.286609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2be48-c59a-4790-b2b3-5de49c687e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.304641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7eb2be48-c59a-4790-b2b3-5de49c687e45 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:58.305852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7eb2be48-c59a-4790-b2b3-5de49c687e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:58.337933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:58.383912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 485/956] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:58.407742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5240c01-e1d1-4a87-8247-10c760797512 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:58.428206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:58.519607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5240c01-e1d1-4a87-8247-10c760797512 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:58.560758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18a471-9301-482e-b0b5-59a1890067ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:58.561496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18a471-9301-482e-b0b5-59a1890067ce None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.561782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18a471-9301-482e-b0b5-59a1890067ce None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.562060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18a471-9301-482e-b0b5-59a1890067ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.562727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18a471-9301-482e-b0b5-59a1890067ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:58.564140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18a471-9301-482e-b0b5-59a1890067ce None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8b18a471-9301-482e-b0b5-59a1890067ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:58.577620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:58.578685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:58.580350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 472/957] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:47:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:58.585682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2be48-c59a-4790-b2b3-5de49c687e45 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:58.610439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e0c2-8462-42af-8ddb-aa4257bea777 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.610735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e0c2-8462-42af-8ddb-aa4257bea777 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.611044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e0c2-8462-42af-8ddb-aa4257bea777 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.616095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 473/958] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:47:58.618255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb728d7-fb61-4b6e-a31b-4de6e8928725 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.618629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb728d7-fb61-4b6e-a31b-4de6e8928725 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.618978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb728d7-fb61-4b6e-a31b-4de6e8928725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.636870 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8cb728d7-fb61-4b6e-a31b-4de6e8928725 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:58.638252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8cb728d7-fb61-4b6e-a31b-4de6e8928725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:58.712384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2be48-c59a-4790-b2b3-5de49c687e45 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:58.724508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 474/959] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:47:58.742194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb728d7-fb61-4b6e-a31b-4de6e8928725 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:58.755107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:58.756045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.757280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.757741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.758653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:58.759153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:58.763374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:58.767621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:58.773870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 486/960] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:47:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:58.780465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:58.817559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:58.881511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb728d7-fb61-4b6e-a31b-4de6e8928725 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:58.909638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996acb1-6a56-4e38-a008-8dd068b0fc6e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:58.920965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:58.922161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.922663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.923141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.935567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:47:58.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:58.946055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:47:58.946889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:58.948475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:58.949156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:58.949443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:58.949725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:58.950513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:58.950721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 475/961] 10.222.0.69 () {56 vars in 1120 bytes} [Thu May 26 17:47:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:58.950819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:58.956675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:58.958201 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:58.958486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 487/962] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:47:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:58.966564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.053554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:59.089141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e169e-6590-45e7-ad8e-d33d44c30724 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.102686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:59.111415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baedb-6764-4988-89dd-3b5acd4915e2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.131337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.132663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.133171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.133660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.134763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:59.135337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:59.137234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:59.154356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 476/963] 10.222.0.69 () {56 vars in 1115 bytes} [Thu May 26 17:47:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:47:59.155721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.159114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521c61d-ad12-4088-a9e7-abfc67c9546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.159856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521c61d-ad12-4088-a9e7-abfc67c9546d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.160239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521c61d-ad12-4088-a9e7-abfc67c9546d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.160537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521c61d-ad12-4088-a9e7-abfc67c9546d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.162501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521c61d-ad12-4088-a9e7-abfc67c9546d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:59.163927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521c61d-ad12-4088-a9e7-abfc67c9546d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:59.200091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 488/964] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:47:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:47:59.287764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474bcc6-9768-41ed-95bc-8f013d09412b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.330753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d291-a46e-44fc-9d01-1b740e9301d0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.331281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d291-a46e-44fc-9d01-1b740e9301d0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.331392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d291-a46e-44fc-9d01-1b740e9301d0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.334118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 489/965] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:47:59.334510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:59.345185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97ce0-7fb0-43c2-8d3a-ce41501aac12 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.345507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97ce0-7fb0-43c2-8d3a-ce41501aac12 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.345673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97ce0-7fb0-43c2-8d3a-ce41501aac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.346031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.347102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.347602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.348131 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.361555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:59.363532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:59.366730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0fa97ce0-7fb0-43c2-8d3a-ce41501aac12 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:47:59.368924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0fa97ce0-7fb0-43c2-8d3a-ce41501aac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:47:59.385417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:59.386390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:59.387398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:47:59.387398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:47:59.387398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:47:59.387398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:59.389787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 477/966] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:59.397690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.468038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 490/967] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:47:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:47:59.487108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa97ce0-7fb0-43c2-8d3a-ce41501aac12 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.534903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060abed-7260-4c3d-9ce6-3493326a55cc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.587235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.588719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.589490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.589968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.591197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:47:59.592168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:59.592410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:59.593852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:59.609761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 478/968] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:47:59.617400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.620048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa97ce0-7fb0-43c2-8d3a-ce41501aac12 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.664951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.665968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.666458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:59.666644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.666935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.667944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:59.669606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:59.671897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING keystone.server.flask.common [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 17:47:59.688398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.sql.core [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 17:47:59.688398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 17:47:59.688398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [parameters: {'user_id': 'a7d5e9844fef45309e6d0284b7135803', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 17:47:59.688398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80193) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() May 26 17:47:59.705109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:47:59.706128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application yield resource May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.rollback() May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.force_reraise() May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise self.value May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application session.commit() May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 17:47:59.707057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._prepare_impl() May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.flush() May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._flush(objects) May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application compat.raise_( May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application flush_context.execute() May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rec.execute(self) May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 17:47:59.708913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:47:59.709973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:47:59.711044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a7d5e9844fef45309e6d0284b7135803', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:59.712154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 17:47:59.713118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 17:47:59.714204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 17:47:59.714204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 17:47:59.714204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 17:47:59.714204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 17:47:59.714204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 17:47:59.714204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:59.714204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 491/969] 10.222.0.69 () {60 vars in 1131 bytes} [Thu May 26 17:47:59 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:59.722082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.740065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a799c-cea0-4e22-92a1-cde139e8898e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.791067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.791917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.792245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.792526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.801001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:59.803479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:59.821803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:59.822816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:47:59.823759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 479/970] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:47:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:47:59.833319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.870844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f52b-3de2-4063-9339-12c270842b6c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.919778 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2ad7a-c177-472a-8609-a29d2b21684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.921578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2ad7a-c177-472a-8609-a29d2b21684b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.922051 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2ad7a-c177-472a-8609-a29d2b21684b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.922534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2ad7a-c177-472a-8609-a29d2b21684b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.934173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2ad7a-c177-472a-8609-a29d2b21684b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:47:59.935998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2ad7a-c177-472a-8609-a29d2b21684b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:47:59.946319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881ce6b-f337-4c87-b043-470ad4b7a5e6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:47:59.948133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f9d2ad7a-c177-472a-8609-a29d2b21684b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:47:59.952219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:47:59.953189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:47:59.954155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 492/971] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:47:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:47:59.955275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0cf9-5548-4162-921b-4d56a9e22ba9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.955441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0cf9-5548-4162-921b-4d56a9e22ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:47:59.955714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0cf9-5548-4162-921b-4d56a9e22ba9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:47:59.965496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 493/972] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:47:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:47:59.965496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc0cf9-5548-4162-921b-4d56a9e22ba9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:47:59.966626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:47:59.998836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70effcbc-1ab9-447b-b049-9cc5816e861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:47:59.999532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70effcbc-1ab9-447b-b049-9cc5816e861d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:47:59.999815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70effcbc-1ab9-447b-b049-9cc5816e861d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:00.000123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70effcbc-1ab9-447b-b049-9cc5816e861d None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:00.000978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70effcbc-1ab9-447b-b049-9cc5816e861d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:00.001290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70effcbc-1ab9-447b-b049-9cc5816e861d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:00.002739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70effcbc-1ab9-447b-b049-9cc5816e861d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:00.021868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 480/973] 10.222.0.69 () {56 vars in 1149 bytes} [Thu May 26 17:47:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:00.024039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a4c2-ff49-401a-8da4-69d8226b2dc9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:00.024621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a4c2-ff49-401a-8da4-69d8226b2dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:00.024899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a4c2-ff49-401a-8da4-69d8226b2dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:00.042502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c896a4c2-ff49-401a-8da4-69d8226b2dc9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:00.043707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c896a4c2-ff49-401a-8da4-69d8226b2dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:00.086768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc0cf9-5548-4162-921b-4d56a9e22ba9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:00.118712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 481/974] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:00.119461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a4c2-ff49-401a-8da4-69d8226b2dc9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:00.131574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:00.133140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:00.133774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:00.134232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:00.135541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:00.136516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:00.138766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:00.179527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 494/975] 10.222.0.69 () {56 vars in 1101 bytes} [Thu May 26 17:47:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:00.180802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:00.231735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:00.243382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a4c2-ff49-401a-8da4-69d8226b2dc9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:00.270937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:00.295434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:00.297095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:00.297620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:00.298172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:00.335389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2637c0-f842-4193-a175-4c343c558814 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:00.378438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:00.379730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:00.380305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:00.380811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:00.381843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:00.383639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:00.390770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:00.392318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:00.407774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 495/976] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:48:00 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:48:00.515044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:00.529319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 482/977] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:48:00.534745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:00.663066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b710-1bbd-4a48-888f-85115ce8f1cb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:00.683023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:00.703007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:00.703810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:00.704129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:00.704410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:00.715343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:00.716830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:00.734471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:00.735512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:00.736543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:00.736543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:00.736543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:00.736543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:00.736543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 496/978] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:00.741915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:00.855382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c08c1-576b-4227-bfda-df8953943dd5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:00.902302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:00.902979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:00.903263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:00.903540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:00.904419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:00.904872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:00.906400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:00.923864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 483/979] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:00.925118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:01.033397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b37132-85d3-4acd-9efe-f16c832678b2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:01.070072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:01.070883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:01.071168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:01.071448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:01.078743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:01.080238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:48:01.096233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:01.097173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:01.098069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:01.100409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 497/980] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:01.103861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:01.159253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:01.215296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f721d6-1faa-4a62-9cec-a7828b64e627 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:01.251256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e61a8-60ab-4c23-8fd3-0de2dfafdc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:01.251930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e61a8-60ab-4c23-8fd3-0de2dfafdc68 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:01.252240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e61a8-60ab-4c23-8fd3-0de2dfafdc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:01.252515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e61a8-60ab-4c23-8fd3-0de2dfafdc68 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:01.253312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e61a8-60ab-4c23-8fd3-0de2dfafdc68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:01.253622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e61a8-60ab-4c23-8fd3-0de2dfafdc68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:01.255817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e61a8-60ab-4c23-8fd3-0de2dfafdc68 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:01.273339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 484/981] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:01.276313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:01.309901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:01.389289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663fed-50ac-4ad5-83d1-cb39f1f430d7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:01.429547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ccdac-fbb5-49f1-b248-c7fc8b9e8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:01.430229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ccdac-fbb5-49f1-b248-c7fc8b9e8962 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:01.430513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ccdac-fbb5-49f1-b248-c7fc8b9e8962 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:01.430792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ccdac-fbb5-49f1-b248-c7fc8b9e8962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:01.431654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ccdac-fbb5-49f1-b248-c7fc8b9e8962 None admin] RBAC: Adding query filter params (role.id=b272da8c4bef43fda8c9ebce7f48e128, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=5927394f6adf4fd0b85d6cdeeec358b6) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:01.431970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ccdac-fbb5-49f1-b248-c7fc8b9e8962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:01.433469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ccdac-fbb5-49f1-b248-c7fc8b9e8962 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:01.448113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 498/982] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:01 2022] GET /identity/v3/role_assignments?user.id=5927394f6adf4fd0b85d6cdeeec358b6&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=b272da8c4bef43fda8c9ebce7f48e128 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:01.563034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac04eea-39ef-4a0e-81e3-02af1ce2cea5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:01.563572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac04eea-39ef-4a0e-81e3-02af1ce2cea5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:01.563572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac04eea-39ef-4a0e-81e3-02af1ce2cea5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:01.565161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 485/983] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:01.572097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5de4-af50-41c4-9ec7-6b92648c7d2d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:01.572418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5de4-af50-41c4-9ec7-6b92648c7d2d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:01.572677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5de4-af50-41c4-9ec7-6b92648c7d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:01.595174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-693d5de4-af50-41c4-9ec7-6b92648c7d2d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:01.596938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-693d5de4-af50-41c4-9ec7-6b92648c7d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:01.682026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 499/984] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:01.705069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac04eea-39ef-4a0e-81e3-02af1ce2cea5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:01.828065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac04eea-39ef-4a0e-81e3-02af1ce2cea5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:01.841036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:01.867734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:01.868578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:01.868858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:01.869132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:01.869791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:01.871176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:01.884535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:01.885622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:48:01.886455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:01.888094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 486/985] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:48:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:01.892380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5de4-af50-41c4-9ec7-6b92648c7d2d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:01.920161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:01.999430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5de4-af50-41c4-9ec7-6b92648c7d2d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:02.036080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:02.036918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:02.037300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:02.037701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:02.038524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:02.039030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:02.040745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:02.050787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 500/986] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:48:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:02.053143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:02.174560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2ad9d-076d-4a0a-96ed-d235255d4265 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:02.214486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:02.215149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:02.215429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:02.215708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:02.216463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:02.216772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:02.218166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:02.223983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 487/987] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:48:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:02.229926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:02.335376 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:02.349555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8ed7-082e-4eb0-a410-6e310cc5860d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:02.384997 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290450d8-18a4-465f-94ce-edaf48a487ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:02.385666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290450d8-18a4-465f-94ce-edaf48a487ff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:02.385950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290450d8-18a4-465f-94ce-edaf48a487ff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:02.386225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290450d8-18a4-465f-94ce-edaf48a487ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:02.387041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290450d8-18a4-465f-94ce-edaf48a487ff None admin] RBAC: Adding query filter params (interface=admin, service_id=c70e0f57af2e49e49fc58a4785a2739f, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:02.387352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290450d8-18a4-465f-94ce-edaf48a487ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:02.388786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290450d8-18a4-465f-94ce-edaf48a487ff None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:02.399499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 501/988] 10.222.0.69 () {56 vars in 1249 bytes} [Thu May 26 17:48:02 2022] GET /identity/v3/endpoints?service_id=c70e0f57af2e49e49fc58a4785a2739f&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:02.401487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:02.444293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:02.508690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b33ff-f82e-4ea8-ad35-1edd217024ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:02.547299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68078ae3-cb6d-4ff8-91e5-e9d4696444dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:02.547990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68078ae3-cb6d-4ff8-91e5-e9d4696444dd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:02.548305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68078ae3-cb6d-4ff8-91e5-e9d4696444dd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:02.548582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68078ae3-cb6d-4ff8-91e5-e9d4696444dd None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:02.549282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68078ae3-cb6d-4ff8-91e5-e9d4696444dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:02.550710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68078ae3-cb6d-4ff8-91e5-e9d4696444dd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:02.564065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 488/989] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:48:02 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:48:02.732841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35e53-a8b0-4460-b850-a23de979a104 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:02.733030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35e53-a8b0-4460-b850-a23de979a104 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:02.733326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35e53-a8b0-4460-b850-a23de979a104 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:02.734786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 502/990] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:02.741753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a068-5481-469f-9047-674058f88bf0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:02.742095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a068-5481-469f-9047-674058f88bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:02.742322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a068-5481-469f-9047-674058f88bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:02.764077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1817a068-5481-469f-9047-674058f88bf0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:02.765454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1817a068-5481-469f-9047-674058f88bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:02.856076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 489/991] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:48:02.876914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35e53-a8b0-4460-b850-a23de979a104 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:03.005929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35e53-a8b0-4460-b850-a23de979a104 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:03.042068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:03.042880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:03.043168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:03.043448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:03.044142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:03.045519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:03.058322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:03.059397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:03.065412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 503/992] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:48:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:03.068037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a068-5481-469f-9047-674058f88bf0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:03.101440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:03.181228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a068-5481-469f-9047-674058f88bf0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:03.216300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:03.216967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:03.217250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:03.217558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:03.218270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:03.218580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:03.219952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:03.230284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 490/993] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:48:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:03.231640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:03.251474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:03.339646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e6af-c1b3-4af5-a504-adbc05650ee5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:03.374675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:03.375356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:03.375645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:03.375928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:03.376696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:03.377011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:03.378413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:03.385060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 504/994] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:48:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:03.390616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:03.492546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:03.499758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc528e3-9146-4153-94d0-8098b3a2e982 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:03.538487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6131c-ac4e-4558-82c5-3490d0a16f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:03.539591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6131c-ac4e-4558-82c5-3490d0a16f34 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:03.540145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6131c-ac4e-4558-82c5-3490d0a16f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:03.540633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6131c-ac4e-4558-82c5-3490d0a16f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:03.542141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6131c-ac4e-4558-82c5-3490d0a16f34 None admin] RBAC: Adding query filter params (interface=public, service_id=bac2ddb69d3f4cb7a497e776911c0db5, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:03.542703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6131c-ac4e-4558-82c5-3490d0a16f34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:03.545297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6131c-ac4e-4558-82c5-3490d0a16f34 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:03.556554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 491/995] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:48:03 2022] GET /identity/v3/endpoints?service_id=bac2ddb69d3f4cb7a497e776911c0db5&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:03.563907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:03.688138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:03.709702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f51f1-86bc-47a1-9463-d4412c313a04 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:03.745296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7c5a-a63c-4da5-b3f9-0998672eb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:03.745988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7c5a-a63c-4da5-b3f9-0998672eb52a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:03.746279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7c5a-a63c-4da5-b3f9-0998672eb52a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:03.746568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7c5a-a63c-4da5-b3f9-0998672eb52a None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:03.747275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7c5a-a63c-4da5-b3f9-0998672eb52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:03.751206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7c5a-a63c-4da5-b3f9-0998672eb52a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:03.764490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 505/996] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:48:03 2022] GET /identity/v3/services => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:48:03.863089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ec07-fbe4-46cb-b5a8-9cb840efc66d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:03.863744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ec07-fbe4-46cb-b5a8-9cb840efc66d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:03.864647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ec07-fbe4-46cb-b5a8-9cb840efc66d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:03.866469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 492/997] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:03.874185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b4ef4-7b64-4332-b4d5-a095ca39e7a2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:03.874574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b4ef4-7b64-4332-b4d5-a095ca39e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:03.874838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b4ef4-7b64-4332-b4d5-a095ca39e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:03.894719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a88b4ef4-7b64-4332-b4d5-a095ca39e7a2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:03.896383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a88b4ef4-7b64-4332-b4d5-a095ca39e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:03.989153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 506/998] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:04.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ec07-fbe4-46cb-b5a8-9cb840efc66d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:04.181577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ec07-fbe4-46cb-b5a8-9cb840efc66d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:04.226595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:04.227581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:04.227991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:04.228437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:04.229243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:04.230815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:04.244913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:04.246899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:04.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 493/999] 10.222.0.69 () {56 vars in 1105 bytes} [Thu May 26 17:48:04 2022] GET /identity/v3/services/image => generated 86 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:04.257500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b4ef4-7b64-4332-b4d5-a095ca39e7a2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:04.354929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:04.390474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b4ef4-7b64-4332-b4d5-a095ca39e7a2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:04.436655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ff48f-8686-45d2-b6ba-4457075b5717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:04.437344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ff48f-8686-45d2-b6ba-4457075b5717 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:04.437626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ff48f-8686-45d2-b6ba-4457075b5717 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:04.437904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ff48f-8686-45d2-b6ba-4457075b5717 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:04.438627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ff48f-8686-45d2-b6ba-4457075b5717 None admin] RBAC: Adding query filter params (name=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:04.438935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ff48f-8686-45d2-b6ba-4457075b5717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:04.440348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ff48f-8686-45d2-b6ba-4457075b5717 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:04.447540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 507/1000] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:04.453755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:04.485982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:04.621235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53623b4d-65bb-48b4-9661-a3fdfeb15fe6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:04.687780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6789d9-439e-49ee-94d6-7be51cbe9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:04.689171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6789d9-439e-49ee-94d6-7be51cbe9399 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:04.689692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6789d9-439e-49ee-94d6-7be51cbe9399 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:04.690200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6789d9-439e-49ee-94d6-7be51cbe9399 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:04.691659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6789d9-439e-49ee-94d6-7be51cbe9399 None admin] RBAC: Adding query filter params (type=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:04.692264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6789d9-439e-49ee-94d6-7be51cbe9399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:04.694983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6789d9-439e-49ee-94d6-7be51cbe9399 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:04.716062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 494/1001] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:05.234005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412bb7-6f41-4066-b94e-f9303506279e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:05.234809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412bb7-6f41-4066-b94e-f9303506279e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:05.235180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412bb7-6f41-4066-b94e-f9303506279e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:05.237796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 508/1002] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:05.247293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5eba8-a148-46fa-871b-f3b28725165c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:05.247812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5eba8-a148-46fa-871b-f3b28725165c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:05.248322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5eba8-a148-46fa-871b-f3b28725165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:05.279535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9ea5eba8-a148-46fa-871b-f3b28725165c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:05.281652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9ea5eba8-a148-46fa-871b-f3b28725165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:05.409672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 495/1003] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:05.448272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412bb7-6f41-4066-b94e-f9303506279e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:05.593122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412bb7-6f41-4066-b94e-f9303506279e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:05.649307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:05.650662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:05.651144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:05.651618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:05.652840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:05.655302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:05.678893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:05.679996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:48:05.681270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:05.682023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 509/1004] 10.222.0.69 () {56 vars in 1126 bytes} [Thu May 26 17:48:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:05.687713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5eba8-a148-46fa-871b-f3b28725165c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:05.723328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:05.853014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5eba8-a148-46fa-871b-f3b28725165c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:05.893674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:05.894824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:05.895265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:05.895674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:05.896746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:05.897187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:05.898745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:05.909426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 496/1005] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:48:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:05.911104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:05.914596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:06.031649 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354830f-b490-4401-a272-39257b85bc03 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:06.072188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e90394-bc6b-418a-b889-c018500c84f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:06.073084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e90394-bc6b-418a-b889-c018500c84f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:06.073497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e90394-bc6b-418a-b889-c018500c84f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:06.073926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e90394-bc6b-418a-b889-c018500c84f9 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:06.074841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e90394-bc6b-418a-b889-c018500c84f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:06.075314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e90394-bc6b-418a-b889-c018500c84f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:06.077040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e90394-bc6b-418a-b889-c018500c84f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:06.089245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 510/1006] 10.222.0.69 () {56 vars in 1122 bytes} [Thu May 26 17:48:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:06.090420 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:06.190807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:06.216774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b27b0-6035-4ecc-a4c3-50d05b41c7b8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:06.258075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52632a6-9d8f-4444-bbf3-c3ee6b354a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:06.259059 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52632a6-9d8f-4444-bbf3-c3ee6b354a23 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:06.259059 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52632a6-9d8f-4444-bbf3-c3ee6b354a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:06.259310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52632a6-9d8f-4444-bbf3-c3ee6b354a23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:06.260088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52632a6-9d8f-4444-bbf3-c3ee6b354a23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:06.261511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52632a6-9d8f-4444-bbf3-c3ee6b354a23 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:06.289186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 497/1007] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:48:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:48:07.237878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584368d-c6d8-4d9e-96c3-e723efe4446b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:07.239229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584368d-c6d8-4d9e-96c3-e723efe4446b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:07.239380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584368d-c6d8-4d9e-96c3-e723efe4446b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:07.241415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 511/1008] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:07.247692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ed2fc-7b72-46d5-aba7-934af4cabfbf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:07.248181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ed2fc-7b72-46d5-aba7-934af4cabfbf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:07.248602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ed2fc-7b72-46d5-aba7-934af4cabfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:07.268741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5d8ed2fc-7b72-46d5-aba7-934af4cabfbf None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:07.271418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d8ed2fc-7b72-46d5-aba7-934af4cabfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:07.362903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 498/1009] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:07.388816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584368d-c6d8-4d9e-96c3-e723efe4446b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:07.471610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:07.517131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584368d-c6d8-4d9e-96c3-e723efe4446b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:07.560152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:07.561073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:07.561354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:07.561683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:07.562367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:07.563815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:07.577828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:07.579696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:07.581413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 512/1010] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:48:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:07.590182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ed2fc-7b72-46d5-aba7-934af4cabfbf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:07.685536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:07.734493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ed2fc-7b72-46d5-aba7-934af4cabfbf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:07.788983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:07.789766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:07.790184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:07.790587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:07.791450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:07.791890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:07.793578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:07.805586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 499/1011] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:48:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:07.807423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:07.991852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1df68-a27b-4a2a-89fc-2c8ed202ce05 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:08.048542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:08.061682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945e164-9cb5-4146-a815-d0f331e113a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:08.063165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945e164-9cb5-4146-a815-d0f331e113a5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:08.063878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945e164-9cb5-4146-a815-d0f331e113a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:08.064602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945e164-9cb5-4146-a815-d0f331e113a5 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:08.066602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945e164-9cb5-4146-a815-d0f331e113a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:08.067448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945e164-9cb5-4146-a815-d0f331e113a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:08.070277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945e164-9cb5-4146-a815-d0f331e113a5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:08.088080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 513/1012] 10.222.0.69 () {56 vars in 1112 bytes} [Thu May 26 17:48:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:08.090757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:08.274868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5fc36-bb60-4f9b-8d35-c58e5f3738d6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:08.275627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5fc36-bb60-4f9b-8d35-c58e5f3738d6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:08.275754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5fc36-bb60-4f9b-8d35-c58e5f3738d6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:08.278881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 514/1013] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:08.288585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6139-5d42-4de2-8321-1e23bf2f8bde None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:08.289065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6139-5d42-4de2-8321-1e23bf2f8bde None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:08.290036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f6139-5d42-4de2-8321-1e23bf2f8bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:08.301799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5453-0bbd-4fa1-8189-2f8f4f8402c1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:08.316057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-841f6139-5d42-4de2-8321-1e23bf2f8bde None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:08.318167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-841f6139-5d42-4de2-8321-1e23bf2f8bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:08.359544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:08.369321 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:08.370442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:08.370926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:08.371379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:08.372835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:08.375381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:08.416053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 500/1014] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:48:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:48:08.445808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 515/1015] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:08.482645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:08.675069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685fd9-de05-4635-8e6d-6334d2711da8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:08.732994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bd0d7-c2e8-4717-921e-c0bd31d191e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:08.733846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bd0d7-c2e8-4717-921e-c0bd31d191e1 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:08.734137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bd0d7-c2e8-4717-921e-c0bd31d191e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:08.734421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bd0d7-c2e8-4717-921e-c0bd31d191e1 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:08.735318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bd0d7-c2e8-4717-921e-c0bd31d191e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:08.737450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bd0d7-c2e8-4717-921e-c0bd31d191e1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:08.765821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 501/1016] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:48:08 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:48:08.889477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391ce8-b924-4267-8182-d24f123b2e21 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:08.889978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391ce8-b924-4267-8182-d24f123b2e21 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:08.890136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391ce8-b924-4267-8182-d24f123b2e21 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:08.891556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 516/1017] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:08.898388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bfb7e-929b-416e-9f68-e355149df39d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:08.898684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bfb7e-929b-416e-9f68-e355149df39d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:08.898987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bfb7e-929b-416e-9f68-e355149df39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:08.918767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a78bfb7e-929b-416e-9f68-e355149df39d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:08.920050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a78bfb7e-929b-416e-9f68-e355149df39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:08.980112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:09.021655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 502/1018] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:48:09.056882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391ce8-b924-4267-8182-d24f123b2e21 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:09.185746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391ce8-b924-4267-8182-d24f123b2e21 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:09.209935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:09.228611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83db86d-b683-4672-a754-db2ba7272dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:09.229590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db86d-b683-4672-a754-db2ba7272dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:09.230012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db86d-b683-4672-a754-db2ba7272dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:09.230495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db86d-b683-4672-a754-db2ba7272dc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:09.231854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83db86d-b683-4672-a754-db2ba7272dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:09.233566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83db86d-b683-4672-a754-db2ba7272dc5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:09.240056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 517/1019] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:09.243253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bfb7e-929b-416e-9f68-e355149df39d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:09.424784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bfb7e-929b-416e-9f68-e355149df39d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:09.490208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755b053-1ab6-4272-ad40-2a7408ca55d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:09.496507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b053-1ab6-4272-ad40-2a7408ca55d3 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:09.497006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b053-1ab6-4272-ad40-2a7408ca55d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:09.497457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b053-1ab6-4272-ad40-2a7408ca55d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:09.498348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755b053-1ab6-4272-ad40-2a7408ca55d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:09.499982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755b053-1ab6-4272-ad40-2a7408ca55d3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:09.536064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 503/1020] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:48:09 2022] POST /identity/v3/projects => generated 311 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:48:11.871559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b372-dc74-4392-91d1-2d7559dca54a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:11.872156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b372-dc74-4392-91d1-2d7559dca54a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:11.872156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b372-dc74-4392-91d1-2d7559dca54a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:11.873535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 518/1021] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:11.880256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f339-d484-4bca-8d96-be77e7797ebe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:11.880763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f339-d484-4bca-8d96-be77e7797ebe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:11.880913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f339-d484-4bca-8d96-be77e7797ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:11.891497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc141c-c9ee-497f-896e-9e7f05f90b54 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:11.891957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc141c-c9ee-497f-896e-9e7f05f90b54 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:11.892418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc141c-c9ee-497f-896e-9e7f05f90b54 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:11.895192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 519/1022] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:11.900229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7dc1f339-d484-4bca-8d96-be77e7797ebe None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:11.901465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7dc1f339-d484-4bca-8d96-be77e7797ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:11.901730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e1ec-ead4-4cfb-84f0-904b4972c19c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:11.902150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e1ec-ead4-4cfb-84f0-904b4972c19c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:11.902563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e1ec-ead4-4cfb-84f0-904b4972c19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:11.922542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1af2e1ec-ead4-4cfb-84f0-904b4972c19c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:11.924227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1af2e1ec-ead4-4cfb-84f0-904b4972c19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:11.927955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:11.989533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 504/1023] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:12.021401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f339-d484-4bca-8d96-be77e7797ebe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.040099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 520/1024] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:48:12.063641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e1ec-ead4-4cfb-84f0-904b4972c19c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.192723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f339-d484-4bca-8d96-be77e7797ebe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:12.231721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e1ec-ead4-4cfb-84f0-904b4972c19c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:12.235523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:12.236391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.236671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.236953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.238283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:12.239763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:12.241765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 505/1025] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:12.247335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.259265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:12.282277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c628c-9e1b-443c-bd2f-a3b8cb603a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:12.283072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c628c-9e1b-443c-bd2f-a3b8cb603a0a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.283515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c628c-9e1b-443c-bd2f-a3b8cb603a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.283854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c628c-9e1b-443c-bd2f-a3b8cb603a0a None admin] PATH_INFO: `/v3/services/image` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.284402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:12.285381 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c628c-9e1b-443c-bd2f-a3b8cb603a0a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:12.287933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c628c-9e1b-443c-bd2f-a3b8cb603a0a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b99c628c-9e1b-443c-bd2f-a3b8cb603a0a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:12.301674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:12.303827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:12.305628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 521/1026] 10.222.0.69 () {56 vars in 1105 bytes} [Thu May 26 17:48:12 2022] GET /identity/v3/services/image => generated 86 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:12.307201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eaf8c-ff1d-4951-a6fd-0da87fa80583 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.307201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eaf8c-ff1d-4951-a6fd-0da87fa80583 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.307201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eaf8c-ff1d-4951-a6fd-0da87fa80583 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.307201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 522/1027] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:12.309158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eaf8c-ff1d-4951-a6fd-0da87fa80583 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.381611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50981d-b898-4ed3-961d-fc29498c2d52 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:12.423600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b524a3-10de-4f58-81e7-7d05da46b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:12.424571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b524a3-10de-4f58-81e7-7d05da46b088 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.425027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b524a3-10de-4f58-81e7-7d05da46b088 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.425568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b524a3-10de-4f58-81e7-7d05da46b088 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.427558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b524a3-10de-4f58-81e7-7d05da46b088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:12.429972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b524a3-10de-4f58-81e7-7d05da46b088 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:12.440253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eaf8c-ff1d-4951-a6fd-0da87fa80583 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:12.462568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 506/1028] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:48:12 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:48:12.464886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe638f4-c09a-4cd8-aa42-7b0b826ef2dc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.465348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe638f4-c09a-4cd8-aa42-7b0b826ef2dc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.465757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe638f4-c09a-4cd8-aa42-7b0b826ef2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.495915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dbe638f4-c09a-4cd8-aa42-7b0b826ef2dc None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:12.498077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dbe638f4-c09a-4cd8-aa42-7b0b826ef2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:12.501438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:12.502544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.503098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.503555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.505134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] RBAC: Adding query filter params (name=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:12.505618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:12.507929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:12.524681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 523/1029] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:12.526588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.611638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:12.628076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 507/1030] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:12.656874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe638f4-c09a-4cd8-aa42-7b0b826ef2dc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.676970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:12.705887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5e55-0808-41ba-8094-c45c87e1e770 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:12.770144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:12.771317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.771831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.772393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.774188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:12.774351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:12.777568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:12.787689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 524/1031] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:12.794470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.836945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe638f4-c09a-4cd8-aa42-7b0b826ef2dc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:12.886841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:12.888102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:12.888516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:12.888988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:12.909069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:12.926573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:12.927789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:48:12.928712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:12.929642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 508/1032] 10.222.0.69 () {56 vars in 1120 bytes} [Thu May 26 17:48:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:12.937061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:12.966158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91cf94-7c44-4225-b3a4-e3ea881173a1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:12.988103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:13.026463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:13.027660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:13.028336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:13.028810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:13.029903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] RBAC: Adding query filter params (interface=public, service_id=131a98e1f8c745b18937915e3cda923a, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:13.030430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:13.032829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:13.042230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 525/1033] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:48:12 2022] GET /identity/v3/endpoints?service_id=131a98e1f8c745b18937915e3cda923a&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:13.048567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:13.058120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:13.128619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85735c4-cf26-4596-a0d5-efe3ef1a9d59 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:13.188657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:13.189667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:13.190100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:13.190526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:13.192301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:13.193090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:13.195448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:13.197957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebfc3-28f0-4446-b4a9-aedb07f7358e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:13.210579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 509/1034] 10.222.0.69 () {56 vars in 1115 bytes} [Thu May 26 17:48:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:13.216379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:13.246031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:13.247417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:13.247535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:13.248306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:13.248495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:13.249919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:13.258085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 526/1035] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:48:13 2022] GET /identity/v3/services => generated 1957 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:48:13.362191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1ed7b-1bdb-466d-ac1a-c9c0bad48c86 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:13.402842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:13.417981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:13.419855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:13.420598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:13.421306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:13.444408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:13.447489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:13.484334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:13.486474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:13.489602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:13.489602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:13.489602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:13.489602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:13.491234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 510/1036] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:13.500411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:13.552878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:13.627219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80861b-0daf-492e-a80e-c43f18e4340b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:13.669210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:13.669883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:13.670165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:13.670436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:13.671163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:13.671466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:13.672873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:13.686411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 527/1037] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:13.694567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:13.832069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4bfaf-4c85-4146-920b-b389bf48e571 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:13.869801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:13.870604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:13.870884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:13.871170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:13.880427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:13.881902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:48:13.897237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:13.899917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:48:13.902322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:13.904904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 511/1038] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:48:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:13.905148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:14.018967 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:14.027520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff31a-6b21-4b8d-8864-1a0dcbdc299b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:14.068223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:14.068916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:14.069195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:14.069471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:14.070365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:14.070682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:14.072159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:14.092317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 528/1039] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:48:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:14.099513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:14.189486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:14.275254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf4a38-d148-4242-bb28-452acec66904 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:14.334309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:14.335400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:14.335898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:14.336436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:14.456763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:14.460086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:14.547184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:14.654010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 512/1040] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:48:14.664651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:14.816337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbbd16-a23b-4013-8092-210bcaea5aa8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:14.858346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84784f7-bac5-45ba-bf62-4fcd0efc24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:14.859183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84784f7-bac5-45ba-bf62-4fcd0efc24ba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:14.859465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84784f7-bac5-45ba-bf62-4fcd0efc24ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:14.859740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84784f7-bac5-45ba-bf62-4fcd0efc24ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:14.873028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84784f7-bac5-45ba-bf62-4fcd0efc24ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:14.874487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84784f7-bac5-45ba-bf62-4fcd0efc24ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f84784f7-bac5-45ba-bf62-4fcd0efc24ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:14.894872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:14.905681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:14.907706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:14.907706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:14.907706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:14.907706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:14.907706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 529/1041] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:14.910173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:15.033865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21eb11-d32d-42d8-8be3-95038a52200b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:15.087327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:15.088411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.088895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.089383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.090871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:15.091448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:15.094329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:15.118867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74cbcc-45ad-4447-95f2-6e4b28c49ee8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.119681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 513/1042] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:15.126182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74cbcc-45ad-4447-95f2-6e4b28c49ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.126182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74cbcc-45ad-4447-95f2-6e4b28c49ee8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.126182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 530/1043] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:15.127938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:15.134350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:15.136743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0176d4-3acb-46c1-9a56-ce0f4644da91 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.137080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0176d4-3acb-46c1-9a56-ce0f4644da91 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.137362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0176d4-3acb-46c1-9a56-ce0f4644da91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.158853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6b0176d4-3acb-46c1-9a56-ce0f4644da91 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:15.160141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6b0176d4-3acb-46c1-9a56-ce0f4644da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:15.162413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:15.243990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 531/1044] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:15.265835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9c963-1ecf-4aac-a07b-bdd61943f0b2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:15.272575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0176d4-3acb-46c1-9a56-ce0f4644da91 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:15.313251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:15.314298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.314717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.315166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.325139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:15.327204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:48:15.346948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:15.349256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:15.355632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 514/1045] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:48:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:15.357843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:15.414292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0176d4-3acb-46c1-9a56-ce0f4644da91 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:15.458787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:15.468256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:15.469061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.469517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.469676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.477978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:15.483314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:15.498765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:15.499800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:15.500676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:15.501318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 532/1046] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:15.509750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:15.521054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420332de-8735-4303-ae76-8e57c1b7cfda None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:15.578244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:15.579235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.579710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.580217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.581429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:15.582577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:15.585024 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:15.609732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 515/1047] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:48:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:15.611488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:15.682095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51662e-02d5-46bc-9b06-c90714d137b2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:15.725246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:15.726278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.726719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.727141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.728436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:15.728957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:15.731428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:15.747496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 533/1048] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:15.755312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:15.766465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d680c96-215a-4c48-a3ee-000c89c3f996 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:15.793902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:15.822675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ef66-efbb-4503-a4a2-af7c318f5e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:15.823825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ef66-efbb-4503-a4a2-af7c318f5e99 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.824355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ef66-efbb-4503-a4a2-af7c318f5e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.824852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ef66-efbb-4503-a4a2-af7c318f5e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.826700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ef66-efbb-4503-a4a2-af7c318f5e99 None admin] RBAC: Adding query filter params (role.id=b272da8c4bef43fda8c9ebce7f48e128, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=9e36af3331a04e13b05fcbb8b2d9cd1e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:15.827278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ef66-efbb-4503-a4a2-af7c318f5e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:15.830194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ef66-efbb-4503-a4a2-af7c318f5e99 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:15.842553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 516/1049] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:15 2022] GET /identity/v3/role_assignments?user.id=9e36af3331a04e13b05fcbb8b2d9cd1e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=b272da8c4bef43fda8c9ebce7f48e128 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:15.857094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:15.947284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc5f1-a48d-47ee-8912-730fb785357b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.948106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60998a8-96a8-4f27-b48e-9a18dee3569d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:15.948259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc5f1-a48d-47ee-8912-730fb785357b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.948259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc5f1-a48d-47ee-8912-730fb785357b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.949628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 517/1050] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:15.955335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1fe4-24ba-4458-9917-97113ec416d4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:15.955629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1fe4-24ba-4458-9917-97113ec416d4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:15.955919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1fe4-24ba-4458-9917-97113ec416d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:15.977416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e42f1fe4-24ba-4458-9917-97113ec416d4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:15.979341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e42f1fe4-24ba-4458-9917-97113ec416d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:16.006448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:16.007578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:16.007869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:16.008186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] PATH_INFO: `/v3/users/fded5d2782d344ae9aa96d7df787e1d0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:16.026414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=fded5d2782d344ae9aa96d7df787e1d0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:16.027934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:16.035577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 534/1051] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:15 2022] GET /identity/v3/users/fded5d2782d344ae9aa96d7df787e1d0 => generated 285 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:16.036377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:16.111050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 518/1052] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:48:16.135258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1fe4-24ba-4458-9917-97113ec416d4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:16.174264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c34bb6-f311-41d2-8eb2-8b1bc9566cc2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:16.195286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:16.216117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:16.216630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:16.216915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:16.217194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:16.295700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:16.297199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:16.313954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1fe4-24ba-4458-9917-97113ec416d4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:16.346746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:16.374606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:16.375610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:16.376106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:16.376540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:16.377448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:16.379283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:16.394997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:16.397209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:48:16.398941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:16.404258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 519/1053] 10.222.0.69 () {56 vars in 1105 bytes} [Thu May 26 17:48:16 2022] GET /identity/v3/services/image => generated 86 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:16.405877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:16.434028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 535/1054] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:48:16.435298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:16.461329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:16.573285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a73e1f-7f69-4da8-99e0-a20b7645aea0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:16.605811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca4837-0df9-4919-8d90-2ee1933f6ec3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:16.625244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:16.625920 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:16.626196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:16.626477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:16.627275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:16.627588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:16.629099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:16.634782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 520/1055] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:16.640424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:16.653015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:16.654099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:16.654571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:16.655025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:16.656538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] RBAC: Authorizing `identity:get_project(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:16.658430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:16.666429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 536/1056] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:16 2022] GET /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a => generated 311 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:16.667999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:16.710068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:16.777999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:16.797169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596e29c-553e-4fa7-8e35-a4c121f162c1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:16.798187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfea76-c58d-471e-8ce1-9df70bbc2335 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:16.846580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b623d-a311-487f-a513-c44daca13995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:16.848159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b623d-a311-487f-a513-c44daca13995 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:16.848457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b623d-a311-487f-a513-c44daca13995 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:16.848741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b623d-a311-487f-a513-c44daca13995 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:16.849478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b623d-a311-487f-a513-c44daca13995 None admin] RBAC: Adding query filter params (type=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:16.849678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672d712-fead-4e58-8bbf-8af49fc7572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:16.849790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b623d-a311-487f-a513-c44daca13995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:16.850785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d712-fead-4e58-8bbf-8af49fc7572f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:16.851235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b623d-a311-487f-a513-c44daca13995 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:16.851351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d712-fead-4e58-8bbf-8af49fc7572f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:16.851758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d712-fead-4e58-8bbf-8af49fc7572f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:16.853364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672d712-fead-4e58-8bbf-8af49fc7572f None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a, user.id=fded5d2782d344ae9aa96d7df787e1d0) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:16.853938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672d712-fead-4e58-8bbf-8af49fc7572f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:16.856685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672d712-fead-4e58-8bbf-8af49fc7572f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:16.862103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 521/1057] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:16.864658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b623d-a311-487f-a513-c44daca13995 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:16.876302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 537/1058] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:16 2022] GET /identity/v3/role_assignments?user.id=fded5d2782d344ae9aa96d7df787e1d0&scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:17.068921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b623d-a311-487f-a513-c44daca13995 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:17.090467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:17.136175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7d715-86d5-4968-beeb-47069b5f537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:17.137229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7d715-86d5-4968-beeb-47069b5f537b None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:17.137728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7d715-86d5-4968-beeb-47069b5f537b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:17.138228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7d715-86d5-4968-beeb-47069b5f537b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:17.139675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7d715-86d5-4968-beeb-47069b5f537b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:17.142341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7d715-86d5-4968-beeb-47069b5f537b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:17.177050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 522/1059] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:48:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:48:18.453826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d554-9338-4b6f-b873-6124078435e9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:18.454391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d554-9338-4b6f-b873-6124078435e9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:18.454491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d554-9338-4b6f-b873-6124078435e9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:18.455878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 538/1060] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:18.462215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b361-5378-4c52-b685-df3562419790 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:18.462683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b361-5378-4c52-b685-df3562419790 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:18.462782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b361-5378-4c52-b685-df3562419790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:18.479765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-afa6b361-5378-4c52-b685-df3562419790 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:18.481004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-afa6b361-5378-4c52-b685-df3562419790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:18.557762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 523/1061] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:18.581403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634d554-9338-4b6f-b873-6124078435e9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:18.743679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634d554-9338-4b6f-b873-6124078435e9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:18.787038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:18.787861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:18.788176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:18.788452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:18.799447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:18.808364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:18.809315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:18.815196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 539/1062] 10.222.0.69 () {56 vars in 1120 bytes} [Thu May 26 17:48:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:18.818544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b361-5378-4c52-b685-df3562419790 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:18.919270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:18.932838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b361-5378-4c52-b685-df3562419790 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:18.971867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:18.973107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:18.973384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:18.973755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:18.974413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:18.974772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:18.976182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:18.985532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 524/1063] 10.222.0.69 () {56 vars in 1115 bytes} [Thu May 26 17:48:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:18.992614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:19.012607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:19.117446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aae183-170a-48b9-9bf8-f82b629dfc20 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:19.161631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:19.162469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.162802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.163080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.182998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:19.185600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:19.209225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:19.211029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:19.217582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:19.217582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:19.217582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:19.217582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:19.217582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 540/1064] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:19.219864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:19.350858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd83fb-269c-4ba0-9ce3-7ed97edf5fb0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:19.391542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928880-64f8-4d44-9328-8ab6b894ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:19.392432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928880-64f8-4d44-9328-8ab6b894ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.392855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928880-64f8-4d44-9328-8ab6b894ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.393266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928880-64f8-4d44-9328-8ab6b894ac0e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.395167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928880-64f8-4d44-9328-8ab6b894ac0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:19.395685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928880-64f8-4d44-9328-8ab6b894ac0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:19.397125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928880-64f8-4d44-9328-8ab6b894ac0e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:19.412109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 525/1065] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:19.417999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:19.464516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee6fb-b3e3-49ac-877a-172a9cf6c889 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.465317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee6fb-b3e3-49ac-877a-172a9cf6c889 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.465317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee6fb-b3e3-49ac-877a-172a9cf6c889 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.466832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 526/1066] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:19.472525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a249-eaf3-449f-a5d1-23cc14b1e086 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.472862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a249-eaf3-449f-a5d1-23cc14b1e086 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.472862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a249-eaf3-449f-a5d1-23cc14b1e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.491815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6580a249-eaf3-449f-a5d1-23cc14b1e086 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:19.493055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6580a249-eaf3-449f-a5d1-23cc14b1e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:19.496434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:19.510026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:19.557167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fee1d9-3a51-47a5-a589-b67754c6ecdd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:19.592302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 527/1067] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:19.598861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:19.599734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.600109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.600337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.609684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:19.611079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:19.615585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a249-eaf3-449f-a5d1-23cc14b1e086 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:48:19.626588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:19.627622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:19.634506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 541/1068] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:48:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:19.635094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:19.740211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a249-eaf3-449f-a5d1-23cc14b1e086 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:19.759648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90363-c4a8-4345-a2b3-7e3d0139170b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:19.785562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:19.788475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b54cdf-b0e4-4c4c-ab0f-d50699332425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:19.789231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54cdf-b0e4-4c4c-ab0f-d50699332425 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.789611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54cdf-b0e4-4c4c-ab0f-d50699332425 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.789912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54cdf-b0e4-4c4c-ab0f-d50699332425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.799814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:19.800293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.800603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.800887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.801935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:19.802254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:19.803736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:19.808177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:19.828639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 542/1069] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:48:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:19.829586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:19.872903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b54cdf-b0e4-4c4c-ab0f-d50699332425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:19.874626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b54cdf-b0e4-4c4c-ab0f-d50699332425 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:19.936585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660424-2010-4e68-a8bd-aeb1178c5cdf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:19.975523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de09b6-b710-4071-aedb-c671c31458e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:19.976615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de09b6-b710-4071-aedb-c671c31458e6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.977092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de09b6-b710-4071-aedb-c671c31458e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.977514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de09b6-b710-4071-aedb-c671c31458e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.984260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 528/1070] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:48:19.986087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ab3c3-1acd-41cd-aebb-2d16f6f96e70 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:19.986380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ab3c3-1acd-41cd-aebb-2d16f6f96e70 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:19.986659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ab3c3-1acd-41cd-aebb-2d16f6f96e70 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:19.988694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 529/1071] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:19.990690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ab3c3-1acd-41cd-aebb-2d16f6f96e70 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:19.992947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de09b6-b710-4071-aedb-c671c31458e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:19.994425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de09b6-b710-4071-aedb-c671c31458e6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-79de09b6-b710-4071-aedb-c671c31458e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:20.014012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:20.015147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:20.016254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:20.016254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:20.016254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:20.016254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:20.016254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 543/1072] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:20.016603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640357-e891-4128-bdf0-d086c8f55dd0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.016815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640357-e891-4128-bdf0-d086c8f55dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.017087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640357-e891-4128-bdf0-d086c8f55dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.034677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-74640357-e891-4128-bdf0-d086c8f55dd0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:20.035995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-74640357-e891-4128-bdf0-d086c8f55dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:20.044850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.063925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.105263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ab3c3-1acd-41cd-aebb-2d16f6f96e70 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.109037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 544/1073] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:20.109898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640357-e891-4128-bdf0-d086c8f55dd0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.146826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.147540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.147824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.148139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.158610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:20.160178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:20.178894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:20.179869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:20.180982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:20.180982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:20.180982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:20.180982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:20.180982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 530/1074] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:20.180982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.217670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640357-e891-4128-bdf0-d086c8f55dd0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.256756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.257444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.257732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.258011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.258842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:20.259071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:20.260500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.273322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 545/1075] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:20.274188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.293400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.300900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.301335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a723-a529-409c-be8d-e5bde3caf9c7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.342396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.343557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.344048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.344506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.358349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:20.367333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:20.368718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:20.369717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:20.372178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 531/1076] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:20.373688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.401218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805a68f-eca6-4d98-b287-2f5997c92bba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.437843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.438520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.438808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.439088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.439822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:20.440173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:20.441843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.460090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 546/1077] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:20.460090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.509445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c217f-2d14-491e-a0d0-752f868e1814 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.568995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.569849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.570441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.570721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.572405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.580112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:20.581731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:48:20.599500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:20.600611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:20.606809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 532/1078] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:20.607297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.614247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb082-05de-4a84-be7b-a33bea779673 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.639804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.672660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.673062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.673348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.673625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.674384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:20.675178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:20.676218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.689315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 547/1079] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:20.697052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.781850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86667f08-1cbe-4578-9ad1-37ffb48a1992 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.833027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.833727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.834013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.834289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.835098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:20.835415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:20.836915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.858124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 533/1080] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:20.858395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde32a99-7b6a-45a4-90c9-29a572fe00e1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:20.866255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.898658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:20.899545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:20.899830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:20.900144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] PATH_INFO: `/v3/users/fded5d2782d344ae9aa96d7df787e1d0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:20.901364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] RBAC: Authorizing `identity:get_user(user_id=fded5d2782d344ae9aa96d7df787e1d0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:20.902805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:20.904648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 548/1081] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/users/fded5d2782d344ae9aa96d7df787e1d0 => generated 285 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:20.910728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:20.927590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.958272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:20.983835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc079b1-b587-440d-b041-d3eff083d283 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:21.022772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:21.023677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:21.023958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:21.024265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/9e36af3331a04e13b05fcbb8b2d9cd1e/roles/b272da8c4bef43fda8c9ebce7f48e128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:21.025800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab72bcf-a161-4ba6-922b-16f7341c60f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:21.026574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=9e36af3331a04e13b05fcbb8b2d9cd1e, role_id=b272da8c4bef43fda8c9ebce7f48e128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:21.028060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:21.044295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 534/1082] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:48:20 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/9e36af3331a04e13b05fcbb8b2d9cd1e/roles/b272da8c4bef43fda8c9ebce7f48e128 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:48:21.066426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dffedb-fddf-4759-ab94-132c549534b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:21.067548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dffedb-fddf-4759-ab94-132c549534b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:21.067941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dffedb-fddf-4759-ab94-132c549534b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:21.068363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dffedb-fddf-4759-ab94-132c549534b1 None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:21.069912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dffedb-fddf-4759-ab94-132c549534b1 None admin] RBAC: Authorizing `identity:get_project(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:21.071511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dffedb-fddf-4759-ab94-132c549534b1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:21.073436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 549/1083] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:20 2022] GET /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:21.080083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:21.195354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104789f-2484-4040-8694-f0b9a2cc87dc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:21.232919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170872ec-7dd9-4d5d-940e-50cdd7434af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:21.233831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170872ec-7dd9-4d5d-940e-50cdd7434af7 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:21.234118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170872ec-7dd9-4d5d-940e-50cdd7434af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:21.234397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170872ec-7dd9-4d5d-940e-50cdd7434af7 None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a/users/fded5d2782d344ae9aa96d7df787e1d0/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:21.236452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170872ec-7dd9-4d5d-940e-50cdd7434af7 None admin] RBAC: Authorizing `identity:create_grant(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a, user_id=fded5d2782d344ae9aa96d7df787e1d0, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:21.238045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170872ec-7dd9-4d5d-940e-50cdd7434af7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:21.243859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:21.258845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 535/1084] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:48:21 2022] PUT /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a/users/fded5d2782d344ae9aa96d7df787e1d0/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:48:23.328822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bfc6e-6b5c-4fa2-9b74-8eaffafeb79b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:23.329568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bfc6e-6b5c-4fa2-9b74-8eaffafeb79b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:23.329568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bfc6e-6b5c-4fa2-9b74-8eaffafeb79b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:23.331066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 550/1085] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:23.340489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce342-56fc-4803-b4c6-baa9099c609f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:23.340489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce342-56fc-4803-b4c6-baa9099c609f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:23.340489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce342-56fc-4803-b4c6-baa9099c609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:23.365534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c73ce342-56fc-4803-b4c6-baa9099c609f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:23.367448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c73ce342-56fc-4803-b4c6-baa9099c609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:23.477530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 536/1086] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:23.502450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bfc6e-6b5c-4fa2-9b74-8eaffafeb79b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:23.580925 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfeff7-ce1f-441d-a459-56438a9fd0d7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:23.581488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfeff7-ce1f-441d-a459-56438a9fd0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:23.581796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfeff7-ce1f-441d-a459-56438a9fd0d7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:23.583384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 537/1087] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:48:23.589266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72195a-1594-427c-8463-0424ebeef27e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:23.589556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72195a-1594-427c-8463-0424ebeef27e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:23.589842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72195a-1594-427c-8463-0424ebeef27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:23.593810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:23.608953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac72195a-1594-427c-8463-0424ebeef27e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:23.610190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac72195a-1594-427c-8463-0424ebeef27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:23.619454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bfc6e-6b5c-4fa2-9b74-8eaffafeb79b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:23.658582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:23.659981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:23.660474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:23.660761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:23.673772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:23.682424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:23.683638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:23.685155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 551/1088] 10.222.0.69 () {56 vars in 1120 bytes} [Thu May 26 17:48:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:23.689991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:23.693067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 538/1089] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:48:23.716637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72195a-1594-427c-8463-0424ebeef27e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:23.783798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:23.814970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82fdb-e12c-44e7-a747-f1fb9cebc72a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:23.837469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72195a-1594-427c-8463-0424ebeef27e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:23.852439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:23.853124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:23.853404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:23.853680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:23.854448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:23.854754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:23.856234 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:23.865811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 552/1090] 10.222.0.69 () {56 vars in 1115 bytes} [Thu May 26 17:48:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:23.872888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:23.875490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:23.876344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:23.876485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:23.876623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:23.876895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:23.889709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:23.899151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:23.900887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:23.902090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 539/1091] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:23.906609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:23.985508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a323394-d051-481c-b9b5-765c0d244e45 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.025454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.026275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.026560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.026840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.036637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65ad8-88dd-48d2-a69d-f9a2b83689c8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.038531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.040047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.055684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:24.059119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:24.061015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:24.063155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:24.063155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:24.063155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:24.063155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:24.063155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 553/1092] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:24.067607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.081504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.082453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.082736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.083016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.083772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:24.084179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.085602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.094335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 540/1093] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:24.101125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.127697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.178921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946868d8-e34a-4da4-986f-7afdceff4e0d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.213533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa6308-681c-4a5a-8f44-3bd2c7b17abd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.217956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.218635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.218916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.219191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.219924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:24.220283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.221659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.235258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 554/1094] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:24.241553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.252091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.253859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.254150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.254423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] PATH_INFO: `/v3/users/fded5d2782d344ae9aa96d7df787e1d0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.255730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] RBAC: Authorizing `identity:get_user(user_id=fded5d2782d344ae9aa96d7df787e1d0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.257222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.259002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 541/1095] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/users/fded5d2782d344ae9aa96d7df787e1d0 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:24.265701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.324388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.361106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e462e7-bd9c-4bfb-a3f0-0bd1f4655055 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.378779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.386732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1284cc-b4ef-4ae7-9ee5-88f4cfeea1de None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.403673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.404507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.404790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.405075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.413931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.415400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.423473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.424296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.424667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.425799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:48:24.430552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:24.432403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:24.433752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 555/1096] 10.222.0.69 () {56 vars in 1093 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:48:24.437413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.505026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.506530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.544927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f4072-141d-41c6-9b56-8963ad5cc06c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.558832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.586510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.587187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.587471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.587747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.588623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:24.588933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.590814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.611039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 556/1097] 10.222.0.69 () {56 vars in 1133 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:24.622060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 542/1098] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:48:24.622235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.623241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.652609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.730101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab692-6327-49ce-adcd-bb889306046b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.739210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84d39c-bf30-43eb-9808-53821cc3bafc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.777585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.778258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.778544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.778819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.790252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.791247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.791628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.792117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.793644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] RBAC: Authorizing `identity:get_project(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.795401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.803158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 543/1099] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:24.804433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:24.821473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.863993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.865695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.899171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:24.916618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c68ae5-7d9e-4cb2-a7d2-b9b08788eb15 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:24.953534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:24.954209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:24.954507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:24.954802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:24.955670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a, user.id=fded5d2782d344ae9aa96d7df787e1d0) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:24.955991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:24.957694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:24.964588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 544/1100] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/role_assignments?user.id=fded5d2782d344ae9aa96d7df787e1d0&scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:24.983878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 557/1101] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:48:24.990583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:25.086314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:25.113126 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611f35-cc9c-4504-b589-5d5f28f64c23 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:25.158784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:25.161098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:25.161098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:25.161446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:25.176611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:25.178098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:25.198245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:25.199235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:25.200221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:48:25.200221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:25.200221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:48:25.200221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:25.200221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 545/1102] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:25.205557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:25.316671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59088671-15d1-4f8f-9aea-e35d8dd1c013 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:25.347853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:25.354173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:25.354859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:25.355147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:25.355430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:25.356212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:25.356529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:25.357933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:25.370921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 558/1103] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:25.377106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:25.497554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb3d5a-bd4c-4804-92f9-6151fa4c6f8c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:25.529140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:25.536540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:25.537403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:25.537687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:25.537962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:25.545514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:25.546977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:48:25.561433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:25.563016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:25.566298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 546/1104] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:25.571209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:25.678522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b897-fbaf-4b4a-8701-200f6e1581f4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:25.716938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498a16-a7b2-49da-b87d-2508c24ac4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:25.717614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498a16-a7b2-49da-b87d-2508c24ac4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:25.717897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498a16-a7b2-49da-b87d-2508c24ac4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:25.718174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498a16-a7b2-49da-b87d-2508c24ac4d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:25.718983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498a16-a7b2-49da-b87d-2508c24ac4d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:25.719291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498a16-a7b2-49da-b87d-2508c24ac4d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:25.720789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498a16-a7b2-49da-b87d-2508c24ac4d5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:25.740332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 559/1105] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:25.741688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:25.859302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870c3b8-9346-4331-93dc-d81f1c2c3dd5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:25.895147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040443f-02ba-49c4-b107-a8a072c42fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:25.895810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040443f-02ba-49c4-b107-a8a072c42fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:25.896128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040443f-02ba-49c4-b107-a8a072c42fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:25.896412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040443f-02ba-49c4-b107-a8a072c42fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:25.897258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040443f-02ba-49c4-b107-a8a072c42fe2 None admin] RBAC: Adding query filter params (role.id=b272da8c4bef43fda8c9ebce7f48e128, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=9e36af3331a04e13b05fcbb8b2d9cd1e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:25.897577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040443f-02ba-49c4-b107-a8a072c42fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:25.899046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040443f-02ba-49c4-b107-a8a072c42fe2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:25.905871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 547/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:25 2022] GET /identity/v3/role_assignments?user.id=9e36af3331a04e13b05fcbb8b2d9cd1e&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=b272da8c4bef43fda8c9ebce7f48e128 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:27.323739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659decf-2555-4376-bc56-fe79897b1110 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:27.324306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659decf-2555-4376-bc56-fe79897b1110 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:27.324306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659decf-2555-4376-bc56-fe79897b1110 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:27.325692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 560/1107] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:27.330854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa5013-832b-49ad-9c92-e4a1cbdaec0c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:27.331293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa5013-832b-49ad-9c92-e4a1cbdaec0c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:27.331498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa5013-832b-49ad-9c92-e4a1cbdaec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:27.349315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cefa5013-832b-49ad-9c92-e4a1cbdaec0c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:27.350515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cefa5013-832b-49ad-9c92-e4a1cbdaec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:27.399984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:27.418503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 548/1108] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:27.443891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659decf-2555-4376-bc56-fe79897b1110 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:27.498704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:27.546914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659decf-2555-4376-bc56-fe79897b1110 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:27.582180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818540af-0a75-4a2a-87c6-84410ff3b8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:27.582932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818540af-0a75-4a2a-87c6-84410ff3b8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:27.583252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818540af-0a75-4a2a-87c6-84410ff3b8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:27.583532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818540af-0a75-4a2a-87c6-84410ff3b8f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:27.584796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818540af-0a75-4a2a-87c6-84410ff3b8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:27.586263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818540af-0a75-4a2a-87c6-84410ff3b8f5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:27.587891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 561/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:27.593746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa5013-832b-49ad-9c92-e4a1cbdaec0c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:27.693928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa5013-832b-49ad-9c92-e4a1cbdaec0c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:27.728064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fdf3c-c1fb-4124-b694-e3382fb46ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:27.728723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdf3c-c1fb-4124-b694-e3382fb46ba7 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:27.729005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdf3c-c1fb-4124-b694-e3382fb46ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:27.729280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdf3c-c1fb-4124-b694-e3382fb46ba7 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:27.729983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fdf3c-c1fb-4124-b694-e3382fb46ba7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:27.731412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fdf3c-c1fb-4124-b694-e3382fb46ba7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:27.757093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 549/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:48:27 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:48:30.045648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757a25e-aeb5-4e98-8c37-ef08051f5d20 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:30.046179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757a25e-aeb5-4e98-8c37-ef08051f5d20 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:30.046179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757a25e-aeb5-4e98-8c37-ef08051f5d20 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:30.047488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 562/1111] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:30.053275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aa953-8dfc-4635-b0e8-b77473bb3ccf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:30.053671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aa953-8dfc-4635-b0e8-b77473bb3ccf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:30.053843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aa953-8dfc-4635-b0e8-b77473bb3ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:30.070461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8e0aa953-8dfc-4635-b0e8-b77473bb3ccf None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:30.071675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8e0aa953-8dfc-4635-b0e8-b77473bb3ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:30.107151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:30.141930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 550/1112] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:30.167256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757a25e-aeb5-4e98-8c37-ef08051f5d20 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:30.267744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757a25e-aeb5-4e98-8c37-ef08051f5d20 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:30.288308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:30.302863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:30.303653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:30.303938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:30.304245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] PATH_INFO: `/v3/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:30.305723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] RBAC: Authorizing `identity:get_role(role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:30.307094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:30.308715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 563/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:30 2022] GET /identity/v3/roles/cdcd22caf11c40b490d53fab54878c23 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:30.314428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aa953-8dfc-4635-b0e8-b77473bb3ccf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:30.412209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aa953-8dfc-4635-b0e8-b77473bb3ccf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:30.444834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:30.445692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:30.445974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:30.446246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] PATH_INFO: `/v3/users/7f488a8b1a1045dd887edb9cdfda655c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:30.461142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] RBAC: Authorizing `identity:get_user(user_id=7f488a8b1a1045dd887edb9cdfda655c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:30.462596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:30.464301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 551/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:30 2022] GET /identity/v3/users/7f488a8b1a1045dd887edb9cdfda655c => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:30.470126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:30.567978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f0642-bfc5-44f9-8a09-9de0bb2e6057 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:30.600934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:30.601583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:30.601871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:30.602147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:30.663332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:30.676478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:30.677932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:30.776822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 564/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:48:30.782720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:30.811058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:30.881950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9e6a0-a825-48b7-83d4-47f7d1b5cbbb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:30.915888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fafeb7-1211-4e9c-ba96-0ac136f7787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:30.916797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fafeb7-1211-4e9c-ba96-0ac136f7787c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:30.917077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fafeb7-1211-4e9c-ba96-0ac136f7787c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:30.917351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fafeb7-1211-4e9c-ba96-0ac136f7787c None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:30.918561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fafeb7-1211-4e9c-ba96-0ac136f7787c None admin] RBAC: Authorizing `identity:get_project(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:30.919998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fafeb7-1211-4e9c-ba96-0ac136f7787c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:30.921729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 552/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:30 2022] GET /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:30.927991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:31.013006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:31.025583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848dc73-adb8-410b-a97f-6521a63c1332 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:31.060553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094b6f8-7b26-4e15-b0d1-3a3fcb320ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:31.061193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094b6f8-7b26-4e15-b0d1-3a3fcb320ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:31.061482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094b6f8-7b26-4e15-b0d1-3a3fcb320ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:31.061763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094b6f8-7b26-4e15-b0d1-3a3fcb320ed3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:31.062596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094b6f8-7b26-4e15-b0d1-3a3fcb320ed3 None admin] RBAC: Adding query filter params (role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a, user.id=7f488a8b1a1045dd887edb9cdfda655c) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:31.062912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094b6f8-7b26-4e15-b0d1-3a3fcb320ed3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:31.064366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094b6f8-7b26-4e15-b0d1-3a3fcb320ed3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:31.070139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 565/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:30 2022] GET /identity/v3/role_assignments?user.id=7f488a8b1a1045dd887edb9cdfda655c&scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:33.265506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e712-252f-43e8-a4dd-9b0ce8223daa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:33.266184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e712-252f-43e8-a4dd-9b0ce8223daa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:33.266184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e712-252f-43e8-a4dd-9b0ce8223daa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:33.267426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 553/1118] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:33.273636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dfe86-e11f-4309-994c-51879b75d7c9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:33.274101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dfe86-e11f-4309-994c-51879b75d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:33.274194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dfe86-e11f-4309-994c-51879b75d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:33.290890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-097dfe86-e11f-4309-994c-51879b75d7c9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:33.292225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-097dfe86-e11f-4309-994c-51879b75d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:33.360852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 566/1119] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:33.384705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843e712-252f-43e8-a4dd-9b0ce8223daa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:33.482230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:33.490031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843e712-252f-43e8-a4dd-9b0ce8223daa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:33.525117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:33.525892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:33.526179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:33.526464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] PATH_INFO: `/v3/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:33.527969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] RBAC: Authorizing `identity:get_role(role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:33.529376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:33.530759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 554/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:33 2022] GET /identity/v3/roles/cdcd22caf11c40b490d53fab54878c23 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:33.537205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dfe86-e11f-4309-994c-51879b75d7c9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:33.618499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:33.638243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dfe86-e11f-4309-994c-51879b75d7c9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:33.672760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:33.673648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:33.673955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:33.674229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] PATH_INFO: `/v3/users/7f488a8b1a1045dd887edb9cdfda655c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:33.675579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] RBAC: Authorizing `identity:get_user(user_id=7f488a8b1a1045dd887edb9cdfda655c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:33.677067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:33.678703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 567/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:33 2022] GET /identity/v3/users/7f488a8b1a1045dd887edb9cdfda655c => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:33.684688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:33.793015 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b70d4-4dbb-4725-9ef6-3b9920041890 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:33.827483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3abb-0f37-4c57-852b-a10f5797749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:33.828365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3abb-0f37-4c57-852b-a10f5797749a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:33.828669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3abb-0f37-4c57-852b-a10f5797749a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:33.828943 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3abb-0f37-4c57-852b-a10f5797749a None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:33.830133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e3abb-0f37-4c57-852b-a10f5797749a None admin] RBAC: Authorizing `identity:get_project(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:33.832342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e3abb-0f37-4c57-852b-a10f5797749a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:33.834142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 555/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:33 2022] GET /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:33.840464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:33.942562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61932-9aa5-4655-bc8e-11639818f445 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:33.980320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdd439-ee8a-4c37-b152-98c3e91ea1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:33.981224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd439-ee8a-4c37-b152-98c3e91ea1f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:33.981561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd439-ee8a-4c37-b152-98c3e91ea1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:33.981993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd439-ee8a-4c37-b152-98c3e91ea1f2 None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a/users/7f488a8b1a1045dd887edb9cdfda655c/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:33.984513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdd439-ee8a-4c37-b152-98c3e91ea1f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a, user_id=7f488a8b1a1045dd887edb9cdfda655c, role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:33.985950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdd439-ee8a-4c37-b152-98c3e91ea1f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:34.000847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 568/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:48:33 2022] PUT /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a/users/7f488a8b1a1045dd887edb9cdfda655c/roles/cdcd22caf11c40b490d53fab54878c23 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:48:36.255769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852896d-cd76-45d7-8e6d-c181f35a2d86 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:36.256390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852896d-cd76-45d7-8e6d-c181f35a2d86 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:36.256390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852896d-cd76-45d7-8e6d-c181f35a2d86 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:36.257770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 556/1124] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:36.263001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e06bb9-7d34-46c3-a9d6-b5991e4638f5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:36.263427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e06bb9-7d34-46c3-a9d6-b5991e4638f5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:36.263546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e06bb9-7d34-46c3-a9d6-b5991e4638f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:36.280480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-79e06bb9-7d34-46c3-a9d6-b5991e4638f5 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:36.281682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-79e06bb9-7d34-46c3-a9d6-b5991e4638f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:36.285041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:36.350563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 569/1125] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:36.374966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852896d-cd76-45d7-8e6d-c181f35a2d86 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:36.407131 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:36.481169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852896d-cd76-45d7-8e6d-c181f35a2d86 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:36.515076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:36.515861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:36.516177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:36.516454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] PATH_INFO: `/v3/roles/cdcd22caf11c40b490d53fab54878c23` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:36.518709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] RBAC: Authorizing `identity:get_role(role_id=cdcd22caf11c40b490d53fab54878c23)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:36.520647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:36.522029 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 557/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:36 2022] GET /identity/v3/roles/cdcd22caf11c40b490d53fab54878c23 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:36.527934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e06bb9-7d34-46c3-a9d6-b5991e4638f5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:36.627183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e06bb9-7d34-46c3-a9d6-b5991e4638f5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:36.662399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:36.663261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:36.663545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:36.663822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] PATH_INFO: `/v3/users/7f488a8b1a1045dd887edb9cdfda655c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:36.665030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] RBAC: Authorizing `identity:get_user(user_id=7f488a8b1a1045dd887edb9cdfda655c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:36.666467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:36.668273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 570/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:36 2022] GET /identity/v3/users/7f488a8b1a1045dd887edb9cdfda655c => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:36.673809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:36.773101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:36.776184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1251f-9b19-49c7-8b7a-13cf61f8ecab None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:36.810740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:36.811382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:36.811666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:36.811939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:36.884498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:36.885981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:36.984372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:36.989042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 558/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:48:36.994874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:37.006826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:37.096975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046d0c7-f533-4317-abc2-e8ddd320193f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:37.130971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145caa9-c292-450a-9192-5c9b57632a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:37.131822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145caa9-c292-450a-9192-5c9b57632a55 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:37.132178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145caa9-c292-450a-9192-5c9b57632a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:37.132469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145caa9-c292-450a-9192-5c9b57632a55 None admin] PATH_INFO: `/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:37.133736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145caa9-c292-450a-9192-5c9b57632a55 None admin] RBAC: Authorizing `identity:get_project(project_id=28ec6eb7d26f4bc194b5ac30c4d52a8a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:37.135222 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145caa9-c292-450a-9192-5c9b57632a55 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:37.137000 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 571/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:36 2022] GET /identity/v3/projects/28ec6eb7d26f4bc194b5ac30c4d52a8a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:37.143601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:37.241957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97e3b-5b35-4eea-909d-15d170314485 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:37.276197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53fa34-ff33-4cf7-a47f-97e292d1b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:37.276848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53fa34-ff33-4cf7-a47f-97e292d1b854 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:37.277130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53fa34-ff33-4cf7-a47f-97e292d1b854 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:37.277407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53fa34-ff33-4cf7-a47f-97e292d1b854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:37.278231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53fa34-ff33-4cf7-a47f-97e292d1b854 None admin] RBAC: Adding query filter params (role.id=cdcd22caf11c40b490d53fab54878c23, scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a, user.id=7f488a8b1a1045dd887edb9cdfda655c) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:37.278545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53fa34-ff33-4cf7-a47f-97e292d1b854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:37.279972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53fa34-ff33-4cf7-a47f-97e292d1b854 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:37.286360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 559/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:37 2022] GET /identity/v3/role_assignments?user.id=7f488a8b1a1045dd887edb9cdfda655c&scope.project.id=28ec6eb7d26f4bc194b5ac30c4d52a8a&role.id=cdcd22caf11c40b490d53fab54878c23 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:39.554077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c9a3-fc48-42b2-a6f8-57d3fb28309e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:39.554626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c9a3-fc48-42b2-a6f8-57d3fb28309e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:39.554626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c9a3-fc48-42b2-a6f8-57d3fb28309e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:39.555998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 572/1131] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:39.561300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95b32-35ca-4028-9884-e5e418ea0167 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:39.561719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95b32-35ca-4028-9884-e5e418ea0167 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:39.561860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95b32-35ca-4028-9884-e5e418ea0167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:39.579561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-96b95b32-35ca-4028-9884-e5e418ea0167 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:39.581313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-96b95b32-35ca-4028-9884-e5e418ea0167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:39.640808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:39.650270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 560/1132] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:39.674499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002c9a3-fc48-42b2-a6f8-57d3fb28309e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:39.753608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:39.777779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002c9a3-fc48-42b2-a6f8-57d3fb28309e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:39.811560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a15d6-c3ac-4f35-841f-e429a82e36e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:39.812319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a15d6-c3ac-4f35-841f-e429a82e36e0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:39.812606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a15d6-c3ac-4f35-841f-e429a82e36e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:39.812883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a15d6-c3ac-4f35-841f-e429a82e36e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:39.814082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a15d6-c3ac-4f35-841f-e429a82e36e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:39.816319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a15d6-c3ac-4f35-841f-e429a82e36e0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:39.817933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 573/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:39.823785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b95b32-35ca-4028-9884-e5e418ea0167 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:39.924909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b95b32-35ca-4028-9884-e5e418ea0167 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:39.961208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1aee-475d-4faa-91fd-9f5a4889e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:39.961868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1aee-475d-4faa-91fd-9f5a4889e8f4 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:39.962179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1aee-475d-4faa-91fd-9f5a4889e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:39.962431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1aee-475d-4faa-91fd-9f5a4889e8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:39.963141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1aee-475d-4faa-91fd-9f5a4889e8f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:39.964629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1aee-475d-4faa-91fd-9f5a4889e8f4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:39.990901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 561/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:48:39 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:48:42.339162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67af6e4-6187-49d5-b92a-7b6c943565fb None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:42.339733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67af6e4-6187-49d5-b92a-7b6c943565fb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:42.339733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67af6e4-6187-49d5-b92a-7b6c943565fb None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:42.341157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 574/1135] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:42.347161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935b43-ec4e-4449-ae1b-141df864fe1d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:42.347638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935b43-ec4e-4449-ae1b-141df864fe1d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:42.347739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935b43-ec4e-4449-ae1b-141df864fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:42.365745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-98935b43-ec4e-4449-ae1b-141df864fe1d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:42.366977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-98935b43-ec4e-4449-ae1b-141df864fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:42.415474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:42.442971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 562/1136] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:42.468623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67af6e4-6187-49d5-b92a-7b6c943565fb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:42.573300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67af6e4-6187-49d5-b92a-7b6c943565fb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:42.608824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78735b49-8637-439a-a410-80717d3124e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:42.609538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78735b49-8637-439a-a410-80717d3124e7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:42.609823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78735b49-8637-439a-a410-80717d3124e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:42.610097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78735b49-8637-439a-a410-80717d3124e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:42.611814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78735b49-8637-439a-a410-80717d3124e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:42.613459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78735b49-8637-439a-a410-80717d3124e7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:42.615142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 575/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:48:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:42.621357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935b43-ec4e-4449-ae1b-141df864fe1d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:42.730164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935b43-ec4e-4449-ae1b-141df864fe1d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:42.771684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008ba71-828b-44a9-8756-04afe9666da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:42.772427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008ba71-828b-44a9-8756-04afe9666da7 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:42.772711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008ba71-828b-44a9-8756-04afe9666da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:42.772988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008ba71-828b-44a9-8756-04afe9666da7 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:42.773731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008ba71-828b-44a9-8756-04afe9666da7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:42.775211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008ba71-828b-44a9-8756-04afe9666da7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:42.797704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 563/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:48:42 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:48:45.226226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d2d2-57bc-44b2-a27d-8af5655f511e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:45.226834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d2d2-57bc-44b2-a27d-8af5655f511e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:45.226834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d2d2-57bc-44b2-a27d-8af5655f511e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:45.228339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 576/1139] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:45.234006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944657-4c83-4b15-89ce-53a12e4ab825 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:45.234466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944657-4c83-4b15-89ce-53a12e4ab825 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:45.234573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944657-4c83-4b15-89ce-53a12e4ab825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:45.252164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f2944657-4c83-4b15-89ce-53a12e4ab825 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:45.253396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f2944657-4c83-4b15-89ce-53a12e4ab825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:45.282811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:45.330402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 564/1140] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:45.353251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67d2d2-57bc-44b2-a27d-8af5655f511e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:45.369012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:45.458225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67d2d2-57bc-44b2-a27d-8af5655f511e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:45.494149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:45.494769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:45.495054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:45.495335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:45.505374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:45.513044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:45.514273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:45.515171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 577/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:48:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:45.521427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2944657-4c83-4b15-89ce-53a12e4ab825 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:45.618922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2944657-4c83-4b15-89ce-53a12e4ab825 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:45.653810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:45.654475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:45.654759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:45.655035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:45.655784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:45.656116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:45.657491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:45.666917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 565/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:48:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:45.672805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:45.747516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:45.780312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eba72e-a826-49d5-8d30-1c6fe558ecaf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:45.817616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:45.818508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:45.818794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:45.819072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] PATH_INFO: `/v3/users/06e30ba6d7aa4922951d3b409e060948` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:45.835143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] RBAC: Authorizing `identity:get_user(user_id=06e30ba6d7aa4922951d3b409e060948)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:45.836699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:45.838556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 578/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:45 2022] GET /identity/v3/users/06e30ba6d7aa4922951d3b409e060948 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:45.844924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:45.873168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:45.953967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc586145-1a2e-41a5-8c87-cb5703904c80 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:45.988477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:45.997512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:45.997512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:45.997512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:46.057957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:46.059354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:46.085848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:46.161688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 566/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:48:46.167659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:46.271673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c039684-0275-4147-b92f-f228cbc3eb23 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:46.301487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:46.308532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b75f0-c0d0-4eb3-b716-2252fd12b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:46.309393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b75f0-c0d0-4eb3-b716-2252fd12b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:46.309764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b75f0-c0d0-4eb3-b716-2252fd12b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:46.310050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b75f0-c0d0-4eb3-b716-2252fd12b1d4 None admin] PATH_INFO: `/v3/projects/ace901148a65475da7b6373fb5f7e8d0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:46.311230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b75f0-c0d0-4eb3-b716-2252fd12b1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=ace901148a65475da7b6373fb5f7e8d0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:46.312691 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b75f0-c0d0-4eb3-b716-2252fd12b1d4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:46.314475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 579/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:46 2022] GET /identity/v3/projects/ace901148a65475da7b6373fb5f7e8d0 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:46.320729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:46.420378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170db36-cb0f-4510-810c-34f95f9b2fe6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:46.445577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:46.458412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fafc65-f368-4782-8ec2-81cada8ca935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:46.459072 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafc65-f368-4782-8ec2-81cada8ca935 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:46.459357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafc65-f368-4782-8ec2-81cada8ca935 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:46.459635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafc65-f368-4782-8ec2-81cada8ca935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:46.460510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fafc65-f368-4782-8ec2-81cada8ca935 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=ace901148a65475da7b6373fb5f7e8d0, user.id=06e30ba6d7aa4922951d3b409e060948) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:46.460825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fafc65-f368-4782-8ec2-81cada8ca935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:46.462289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fafc65-f368-4782-8ec2-81cada8ca935 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:46.468179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 567/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:46 2022] GET /identity/v3/role_assignments?user.id=06e30ba6d7aa4922951d3b409e060948&scope.project.id=ace901148a65475da7b6373fb5f7e8d0&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:48.754751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848b91e-55b6-40c2-ab90-e05b516b418b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:48.755216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848b91e-55b6-40c2-ab90-e05b516b418b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:48.755336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848b91e-55b6-40c2-ab90-e05b516b418b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:48.756722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 580/1147] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:48.762220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90d3f-05d1-42b4-a751-51c1c035a1b6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:48.762716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90d3f-05d1-42b4-a751-51c1c035a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:48.762838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90d3f-05d1-42b4-a751-51c1c035a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:48.779656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d7d90d3f-05d1-42b4-a751-51c1c035a1b6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:48.780882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7d90d3f-05d1-42b4-a751-51c1c035a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:48.846719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 568/1148] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:48.869366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848b91e-55b6-40c2-ab90-e05b516b418b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:48.976582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848b91e-55b6-40c2-ab90-e05b516b418b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:49.010610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:49.011328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:49.011616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:49.011897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:49.022369 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:49.030006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:49.031102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:49.032321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 581/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:49.037905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d90d3f-05d1-42b4-a751-51c1c035a1b6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:49.140604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d90d3f-05d1-42b4-a751-51c1c035a1b6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:49.158536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:49.175803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:49.176510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:49.176792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:49.177066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:49.177813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:49.178121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:49.179500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:49.187817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 569/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:49.194335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:49.255547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:49.298289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705c17-bbf6-457c-9df6-0ddc06e60a6c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:49.332438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:49.333321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:49.333608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:49.333911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] PATH_INFO: `/v3/users/06e30ba6d7aa4922951d3b409e060948` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:49.335085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=06e30ba6d7aa4922951d3b409e060948)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:49.336567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:49.338212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 582/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:49 2022] GET /identity/v3/users/06e30ba6d7aa4922951d3b409e060948 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:49.344177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:49.442818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d2e9-397b-40a2-b22a-aa3746d9506a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:49.476947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf5f5-92ec-4f0f-a7bf-0c3151dbba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:49.477812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf5f5-92ec-4f0f-a7bf-0c3151dbba14 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:49.478102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf5f5-92ec-4f0f-a7bf-0c3151dbba14 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:49.478380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf5f5-92ec-4f0f-a7bf-0c3151dbba14 None admin] PATH_INFO: `/v3/projects/ace901148a65475da7b6373fb5f7e8d0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:49.479560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf5f5-92ec-4f0f-a7bf-0c3151dbba14 None admin] RBAC: Authorizing `identity:get_project(project_id=ace901148a65475da7b6373fb5f7e8d0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:49.481063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf5f5-92ec-4f0f-a7bf-0c3151dbba14 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:49.482771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 570/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:49 2022] GET /identity/v3/projects/ace901148a65475da7b6373fb5f7e8d0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:49.489523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:49.591702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd90b-9c17-44dc-9619-1ed48c75b4b2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:49.617803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:49.627155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3252-81a1-43a4-825a-f123a852c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:49.628127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3252-81a1-43a4-825a-f123a852c171 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:49.628449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3252-81a1-43a4-825a-f123a852c171 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:49.628754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3252-81a1-43a4-825a-f123a852c171 None admin] PATH_INFO: `/v3/projects/ace901148a65475da7b6373fb5f7e8d0/users/06e30ba6d7aa4922951d3b409e060948/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:49.630802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3252-81a1-43a4-825a-f123a852c171 None admin] RBAC: Authorizing `identity:create_grant(project_id=ace901148a65475da7b6373fb5f7e8d0, user_id=06e30ba6d7aa4922951d3b409e060948, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:49.632324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3252-81a1-43a4-825a-f123a852c171 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:49.648476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 583/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:48:49 2022] PUT /identity/v3/projects/ace901148a65475da7b6373fb5f7e8d0/users/06e30ba6d7aa4922951d3b409e060948/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:48:51.856921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62103871-cd09-4f66-bbcf-3a78fed4bb72 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:51.857492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62103871-cd09-4f66-bbcf-3a78fed4bb72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:51.857492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62103871-cd09-4f66-bbcf-3a78fed4bb72 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:51.858875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 571/1154] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:51.865407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb318bd3-ad0f-4839-ba75-7d30abac275c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:51.865955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb318bd3-ad0f-4839-ba75-7d30abac275c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:51.865955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb318bd3-ad0f-4839-ba75-7d30abac275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:51.884886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bb318bd3-ad0f-4839-ba75-7d30abac275c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:51.886125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bb318bd3-ad0f-4839-ba75-7d30abac275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:51.958978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 584/1155] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:51.983226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62103871-cd09-4f66-bbcf-3a78fed4bb72 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:52.041411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:52.100238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62103871-cd09-4f66-bbcf-3a78fed4bb72 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:52.143463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:52.144281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:52.144575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:52.144857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:52.156214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:48:52.164315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:52.165423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:48:52.166261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 572/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:52.171736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb318bd3-ad0f-4839-ba75-7d30abac275c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:52.277731 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb318bd3-ad0f-4839-ba75-7d30abac275c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:52.295014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:52.315300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:52.315989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:52.316311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:52.316596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:52.317357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:52.317675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:52.319059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:52.327844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 585/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:52.334728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:52.438667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca127d6-2b79-4bb9-83b0-c05e23ee218d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:52.448633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:52.478890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:52.479761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:52.480068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:52.480349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] PATH_INFO: `/v3/users/06e30ba6d7aa4922951d3b409e060948` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:52.481668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=06e30ba6d7aa4922951d3b409e060948)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:52.483114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:52.485482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 573/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:48:52 2022] GET /identity/v3/users/06e30ba6d7aa4922951d3b409e060948 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:52.490879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:52.607271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e5b5-e9af-49b2-aa51-7ea815443839 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:52.647330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368312-002c-4672-adaf-b26588123165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:52.648089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368312-002c-4672-adaf-b26588123165 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:52.648424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368312-002c-4672-adaf-b26588123165 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:52.648705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368312-002c-4672-adaf-b26588123165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:52.702858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:52.732585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa368312-002c-4672-adaf-b26588123165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:52.734541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa368312-002c-4672-adaf-b26588123165 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:52.852253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 586/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:48:52.859332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:52.975260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152441b9-0195-4aac-8ab7-12b1a2ae5dd1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:53.016422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907921e-6dc2-464a-9cef-4f55e3fbca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:53.017804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907921e-6dc2-464a-9cef-4f55e3fbca10 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:53.018087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907921e-6dc2-464a-9cef-4f55e3fbca10 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:53.018366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907921e-6dc2-464a-9cef-4f55e3fbca10 None admin] PATH_INFO: `/v3/projects/ace901148a65475da7b6373fb5f7e8d0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:53.019556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907921e-6dc2-464a-9cef-4f55e3fbca10 None admin] RBAC: Authorizing `identity:get_project(project_id=ace901148a65475da7b6373fb5f7e8d0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:53.021041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907921e-6dc2-464a-9cef-4f55e3fbca10 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:53.022764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 574/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:48:52 2022] GET /identity/v3/projects/ace901148a65475da7b6373fb5f7e8d0 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:53.029241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368312-002c-4672-adaf-b26588123165 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:53.118760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:53.143219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368312-002c-4672-adaf-b26588123165 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:53.182450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0755d3-c97f-42bc-99d9-dcfd91c36f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:53.183109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0755d3-c97f-42bc-99d9-dcfd91c36f04 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:53.183412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0755d3-c97f-42bc-99d9-dcfd91c36f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:53.183726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0755d3-c97f-42bc-99d9-dcfd91c36f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:53.184758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0755d3-c97f-42bc-99d9-dcfd91c36f04 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=ace901148a65475da7b6373fb5f7e8d0, user.id=06e30ba6d7aa4922951d3b409e060948) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:53.185158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0755d3-c97f-42bc-99d9-dcfd91c36f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:53.186871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0755d3-c97f-42bc-99d9-dcfd91c36f04 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:53.193803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 587/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:48:53 2022] GET /identity/v3/role_assignments?user.id=06e30ba6d7aa4922951d3b409e060948&scope.project.id=ace901148a65475da7b6373fb5f7e8d0&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:48:55.508592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660080-30c3-42a1-9773-a22f0a3b685e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:55.509146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660080-30c3-42a1-9773-a22f0a3b685e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:55.509146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660080-30c3-42a1-9773-a22f0a3b685e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:55.510525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 575/1162] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:55.516724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093c31-7dbb-4999-a6cd-91353926fbb8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:55.517515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093c31-7dbb-4999-a6cd-91353926fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:55.517642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093c31-7dbb-4999-a6cd-91353926fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:55.535073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5d093c31-7dbb-4999-a6cd-91353926fbb8 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:55.536336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5d093c31-7dbb-4999-a6cd-91353926fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:55.605051 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 588/1163] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:55.629560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a660080-30c3-42a1-9773-a22f0a3b685e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:55.679562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:55.736212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a660080-30c3-42a1-9773-a22f0a3b685e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:55.773035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:55.773613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:55.773893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:55.774168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:55.840681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:55.842139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:55.886547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:55.943595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 576/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:48:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:48:55.949930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d093c31-7dbb-4999-a6cd-91353926fbb8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:56.020807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:56.049881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d093c31-7dbb-4999-a6cd-91353926fbb8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:56.083516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b8825-fac9-4436-ae3a-9e6924139125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:56.084354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8825-fac9-4436-ae3a-9e6924139125 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:56.084643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8825-fac9-4436-ae3a-9e6924139125 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:56.084921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8825-fac9-4436-ae3a-9e6924139125 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:56.091550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b8825-fac9-4436-ae3a-9e6924139125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:56.093016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b8825-fac9-4436-ae3a-9e6924139125 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ef0b8825-fac9-4436-ae3a-9e6924139125 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:48:56.107164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:48:56.108373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:48:56.109272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 589/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:48:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:48:56.115605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:56.215143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa07dd-2f55-43e6-a00f-2c62af23a4f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:56.249313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf1f21-81a0-412b-ae3e-148cb5292347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:56.249974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf1f21-81a0-412b-ae3e-148cb5292347 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:56.250256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf1f21-81a0-412b-ae3e-148cb5292347 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:56.250531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf1f21-81a0-412b-ae3e-148cb5292347 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:56.252317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf1f21-81a0-412b-ae3e-148cb5292347 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:48:56.252651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf1f21-81a0-412b-ae3e-148cb5292347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:56.254034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf1f21-81a0-412b-ae3e-148cb5292347 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:56.261454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 577/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Thu May 26 17:48:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:48:58.552264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd55e-951c-4dc6-a005-feeaac29ce42 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:58.552839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd55e-951c-4dc6-a005-feeaac29ce42 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:58.552839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd55e-951c-4dc6-a005-feeaac29ce42 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:58.554190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 590/1167] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:48:58.559380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319200e6-0e6a-477f-af73-631333f38e0f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:58.559779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319200e6-0e6a-477f-af73-631333f38e0f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:58.559946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319200e6-0e6a-477f-af73-631333f38e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:58.578097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-319200e6-0e6a-477f-af73-631333f38e0f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:48:58.579397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-319200e6-0e6a-477f-af73-631333f38e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:48:58.581505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:58.648615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 578/1168] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:48:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:48:58.672307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd55e-951c-4dc6-a005-feeaac29ce42 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:48:58.777597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd55e-951c-4dc6-a005-feeaac29ce42 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:48:58.811682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:48:58.818135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb0d67-ff84-4e66-b1e6-436347887bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:48:58.818927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb0d67-ff84-4e66-b1e6-436347887bb9 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:48:58.819248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb0d67-ff84-4e66-b1e6-436347887bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:48:58.819769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb0d67-ff84-4e66-b1e6-436347887bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:48:58.820730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb0d67-ff84-4e66-b1e6-436347887bb9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:48:58.822281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb0d67-ff84-4e66-b1e6-436347887bb9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:48:58.840438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 591/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Thu May 26 17:48:58 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:49:01.191828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25bb9-8f2e-4424-a5af-8828323cdfc1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:01.192430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25bb9-8f2e-4424-a5af-8828323cdfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:01.192430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25bb9-8f2e-4424-a5af-8828323cdfc1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:01.193903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 579/1170] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:49:01.199318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7e94-3d72-4da3-91c4-070f8088061a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:01.199813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7e94-3d72-4da3-91c4-070f8088061a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:01.199931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7e94-3d72-4da3-91c4-070f8088061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:01.217781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-024b7e94-3d72-4da3-91c4-070f8088061a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:49:01.218998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-024b7e94-3d72-4da3-91c4-070f8088061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:49:01.287119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 592/1171] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:49:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:49:01.311158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25bb9-8f2e-4424-a5af-8828323cdfc1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:01.412507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25bb9-8f2e-4424-a5af-8828323cdfc1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:01.446250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721550f-87ac-4c42-803c-b9c601dfb945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:01.447031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721550f-87ac-4c42-803c-b9c601dfb945 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:01.447316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721550f-87ac-4c42-803c-b9c601dfb945 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:01.447595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721550f-87ac-4c42-803c-b9c601dfb945 None admin] PATH_INFO: `/v3/domains/0cb455f4013d47bd8dd9094e72f618aa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:01.455369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:01.460252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721550f-87ac-4c42-803c-b9c601dfb945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0cb455f4013d47bd8dd9094e72f618aa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:01.461772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721550f-87ac-4c42-803c-b9c601dfb945 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:01.463465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 580/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Thu May 26 17:49:01 2022] GET /identity/v3/domains/0cb455f4013d47bd8dd9094e72f618aa => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:01.469267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b7e94-3d72-4da3-91c4-070f8088061a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:01.569040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b7e94-3d72-4da3-91c4-070f8088061a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:01.591494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:01.605043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d07a77-1e8a-4ba6-9bcd-e1045435cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:01.605710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07a77-1e8a-4ba6-9bcd-e1045435cfdf None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:01.605996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07a77-1e8a-4ba6-9bcd-e1045435cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:01.606296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07a77-1e8a-4ba6-9bcd-e1045435cfdf None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:01.607016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d07a77-1e8a-4ba6-9bcd-e1045435cfdf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:01.608512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d07a77-1e8a-4ba6-9bcd-e1045435cfdf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:01.635049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 593/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:49:01 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:49:03.927297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96604d-b5c0-4ebf-a024-98e8041829a1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:03.927826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96604d-b5c0-4ebf-a024-98e8041829a1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:03.927911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96604d-b5c0-4ebf-a024-98e8041829a1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:03.929264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 581/1174] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:49:03.934613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fbe91-b9b2-4690-8f92-275db00f981e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:03.935046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fbe91-b9b2-4690-8f92-275db00f981e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:03.935221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fbe91-b9b2-4690-8f92-275db00f981e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:03.952484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e48fbe91-b9b2-4690-8f92-275db00f981e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:49:03.953691 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e48fbe91-b9b2-4690-8f92-275db00f981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:49:04.020993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 594/1175] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:49:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:49:04.045421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96604d-b5c0-4ebf-a024-98e8041829a1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:04.148191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96604d-b5c0-4ebf-a024-98e8041829a1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:04.181327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa2e88-8ff5-4e79-a9f8-71100a850ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:04.182183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa2e88-8ff5-4e79-a9f8-71100a850ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:04.182464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa2e88-8ff5-4e79-a9f8-71100a850ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:04.182740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa2e88-8ff5-4e79-a9f8-71100a850ed2 None admin] PATH_INFO: `/v3/domains/0cb455f4013d47bd8dd9094e72f618aa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:04.183908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa2e88-8ff5-4e79-a9f8-71100a850ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0cb455f4013d47bd8dd9094e72f618aa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:04.185383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa2e88-8ff5-4e79-a9f8-71100a850ed2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:04.186990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 582/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Thu May 26 17:49:04 2022] GET /identity/v3/domains/0cb455f4013d47bd8dd9094e72f618aa => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:04.193910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fbe91-b9b2-4690-8f92-275db00f981e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:04.290970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fbe91-b9b2-4690-8f92-275db00f981e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:04.293230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:04.326174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c44b-23c4-48c7-8f4b-bf5f1605886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:04.326850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c44b-23c4-48c7-8f4b-bf5f1605886f None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:04.327139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c44b-23c4-48c7-8f4b-bf5f1605886f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:04.327420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c44b-23c4-48c7-8f4b-bf5f1605886f None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:04.328154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c44b-23c4-48c7-8f4b-bf5f1605886f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:04.330323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c44b-23c4-48c7-8f4b-bf5f1605886f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:04.350575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 595/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:49:04 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:49:06.706304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051da5-222c-4512-b731-94af557dfb0d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:06.706853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051da5-222c-4512-b731-94af557dfb0d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:06.706853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051da5-222c-4512-b731-94af557dfb0d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:06.708497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 583/1178] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:49:06.714075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaba2da-1a4e-4add-a051-a99fb44cf143 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:06.714515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaba2da-1a4e-4add-a051-a99fb44cf143 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:06.714644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaba2da-1a4e-4add-a051-a99fb44cf143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:06.733749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-feaba2da-1a4e-4add-a051-a99fb44cf143 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:49:06.734972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-feaba2da-1a4e-4add-a051-a99fb44cf143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:49:06.809720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 596/1179] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:49:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:49:06.834961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051da5-222c-4512-b731-94af557dfb0d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:06.918215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:06.959724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051da5-222c-4512-b731-94af557dfb0d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:07.002327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:07.003233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:07.003751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:07.004268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:07.020410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:49:07.028754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:49:07.029863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:49:07.030824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 584/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:49:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:49:07.036368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaba2da-1a4e-4add-a051-a99fb44cf143 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:07.135468 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:07.147102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaba2da-1a4e-4add-a051-a99fb44cf143 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:07.180949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:07.181622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:07.181908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:07.182185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:07.182940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:49:07.183251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:07.184670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:07.193575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 597/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:07.199440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:07.300727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c349a-3863-4f97-89c5-be8b3a4aeac0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:07.326426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:07.335607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:07.336521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:07.336813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:07.337098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] PATH_INFO: `/v3/users/f56a1cb425e5462d9694c64a97de423d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:07.351779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=f56a1cb425e5462d9694c64a97de423d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:07.353308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:07.355041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 585/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:49:07 2022] GET /identity/v3/users/f56a1cb425e5462d9694c64a97de423d => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:07.361210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:07.462159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d237a-de22-4496-9e16-74936f4168c8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:07.496153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:07.496816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:07.497103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:07.497381 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:07.535493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:07.583014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:07.584438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:07.684097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 598/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:49:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:49:07.689959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:07.792235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795ff46-6de0-46e4-88e5-277af058b5c4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:07.826563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7f8b-8e0d-4924-87cf-a522efcb3e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:07.827437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7f8b-8e0d-4924-87cf-a522efcb3e25 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:07.827721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7f8b-8e0d-4924-87cf-a522efcb3e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:07.828036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7f8b-8e0d-4924-87cf-a522efcb3e25 None admin] PATH_INFO: `/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:07.829387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc7f8b-8e0d-4924-87cf-a522efcb3e25 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed44c18e2d14044b161dc3c74b99c9c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:07.830932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc7f8b-8e0d-4924-87cf-a522efcb3e25 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:07.832683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 586/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:49:07 2022] GET /identity/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:07.838887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:07.890579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:07.938318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290867f1-fa6d-45ac-89a1-39b1e81bafc0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:07.972501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6bc9a-aaec-4438-94a8-3e966e83d38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:07.973155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bc9a-aaec-4438-94a8-3e966e83d38a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:07.973438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bc9a-aaec-4438-94a8-3e966e83d38a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:07.973708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bc9a-aaec-4438-94a8-3e966e83d38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:07.974534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6bc9a-aaec-4438-94a8-3e966e83d38a None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=6ed44c18e2d14044b161dc3c74b99c9c, user.id=f56a1cb425e5462d9694c64a97de423d) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:49:07.974844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6bc9a-aaec-4438-94a8-3e966e83d38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:07.976300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6bc9a-aaec-4438-94a8-3e966e83d38a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:07.981923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 599/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:49:07 2022] GET /identity/v3/role_assignments?user.id=f56a1cb425e5462d9694c64a97de423d&scope.project.id=6ed44c18e2d14044b161dc3c74b99c9c&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:10.214177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accee418-af58-42e4-974b-ea44f950394e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:10.214702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accee418-af58-42e4-974b-ea44f950394e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:10.214795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accee418-af58-42e4-974b-ea44f950394e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:10.216117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 587/1186] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:49:10.221542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795534f-421b-41ea-aaa5-d9367b88c488 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:10.222020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795534f-421b-41ea-aaa5-d9367b88c488 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:10.222117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795534f-421b-41ea-aaa5-d9367b88c488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:10.239382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d795534f-421b-41ea-aaa5-d9367b88c488 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:49:10.240616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d795534f-421b-41ea-aaa5-d9367b88c488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:49:10.306575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 600/1187] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:49:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:49:10.330395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accee418-af58-42e4-974b-ea44f950394e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:10.383968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:10.430098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accee418-af58-42e4-974b-ea44f950394e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:10.464167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:10.465012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:10.465244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:10.465524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:10.475574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:49:10.483163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:49:10.484329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:49:10.486511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 588/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:49:10.491247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795534f-421b-41ea-aaa5-d9367b88c488 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:10.536564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:10.589892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795534f-421b-41ea-aaa5-d9367b88c488 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:10.624005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:10.624700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:10.624990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:10.625307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:10.626049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:49:10.626360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:10.627726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:10.635751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 601/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:10.643098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:10.741907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3006f-fa71-4e63-9eca-67d1c96871b8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:10.754495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:10.776242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:10.777117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:10.777404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:10.777682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] PATH_INFO: `/v3/users/f56a1cb425e5462d9694c64a97de423d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:10.778859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=f56a1cb425e5462d9694c64a97de423d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:10.780344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:10.782517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 589/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:49:10 2022] GET /identity/v3/users/f56a1cb425e5462d9694c64a97de423d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:10.788494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:10.885576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865b434-3d85-4c5b-a88f-7243608358a5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:10.894378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:10.919536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca781c-ea5d-4945-a37b-e1a30ccbc698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:10.920421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca781c-ea5d-4945-a37b-e1a30ccbc698 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:10.920708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca781c-ea5d-4945-a37b-e1a30ccbc698 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:10.920987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca781c-ea5d-4945-a37b-e1a30ccbc698 None admin] PATH_INFO: `/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:10.922307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca781c-ea5d-4945-a37b-e1a30ccbc698 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed44c18e2d14044b161dc3c74b99c9c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:10.923756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca781c-ea5d-4945-a37b-e1a30ccbc698 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:10.925493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 602/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:49:10 2022] GET /identity/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:10.931435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:11.029549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7347df-f339-4b8e-bd18-901b47efb5f0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:11.061865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58810-168a-4888-8cc2-a70ad5377f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:11.062766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58810-168a-4888-8cc2-a70ad5377f26 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:11.063145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58810-168a-4888-8cc2-a70ad5377f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:11.063923 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58810-168a-4888-8cc2-a70ad5377f26 None admin] PATH_INFO: `/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c/users/f56a1cb425e5462d9694c64a97de423d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:11.065899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f58810-168a-4888-8cc2-a70ad5377f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ed44c18e2d14044b161dc3c74b99c9c, user_id=f56a1cb425e5462d9694c64a97de423d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:11.067326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f58810-168a-4888-8cc2-a70ad5377f26 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:11.079759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 590/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:49:10 2022] PUT /identity/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c/users/f56a1cb425e5462d9694c64a97de423d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:49:13.269093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d68f1c-ec80-4e3f-bc44-2fa896118cc6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:13.269630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d68f1c-ec80-4e3f-bc44-2fa896118cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:13.269715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d68f1c-ec80-4e3f-bc44-2fa896118cc6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:13.271029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 603/1193] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:49:13.276275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07a18-40db-41e1-9d95-4ec58f3b2c1d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:13.276666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07a18-40db-41e1-9d95-4ec58f3b2c1d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:13.276837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07a18-40db-41e1-9d95-4ec58f3b2c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:13.293292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4fc07a18-40db-41e1-9d95-4ec58f3b2c1d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:49:13.294461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4fc07a18-40db-41e1-9d95-4ec58f3b2c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:49:13.329834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:13.364119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 591/1194] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:49:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:49:13.387422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d68f1c-ec80-4e3f-bc44-2fa896118cc6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:13.495878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d68f1c-ec80-4e3f-bc44-2fa896118cc6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:13.533329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:13.534050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:13.534340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:13.534623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:13.545385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:49:13.553088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:49:13.554147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:49:13.555276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 604/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:49:13.560441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc07a18-40db-41e1-9d95-4ec58f3b2c1d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:13.662159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc07a18-40db-41e1-9d95-4ec58f3b2c1d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:13.697528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:13.698193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:13.698482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:13.698763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:13.699511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:49:13.699822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:13.701232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:13.709245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 592/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:13.715100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:13.751569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:13.817332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeb1a6-c7ed-4493-8b27-525b9b3a095e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:13.851648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:13.852565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:13.852853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:13.853132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] PATH_INFO: `/v3/users/f56a1cb425e5462d9694c64a97de423d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:13.854399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] RBAC: Authorizing `identity:get_user(user_id=f56a1cb425e5462d9694c64a97de423d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:13.855888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:13.857572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 605/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Thu May 26 17:49:13 2022] GET /identity/v3/users/f56a1cb425e5462d9694c64a97de423d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:13.863989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:13.895928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:13.964604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507eae-7e6c-4954-9cdf-b9adbb508eaa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:13.997502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:13.998147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:13.998431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:13.998709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:14.063935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:14.065436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:14.094363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:14.163041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 593/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:49:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:49:14.169036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:14.267387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55df65-0787-496e-a805-5ce84423830e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:14.269840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:14.302438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54493-c4de-458d-af37-fd0b9fd5b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:14.303327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54493-c4de-458d-af37-fd0b9fd5b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:14.303610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54493-c4de-458d-af37-fd0b9fd5b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:14.303886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54493-c4de-458d-af37-fd0b9fd5b7a3 None admin] PATH_INFO: `/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:14.305197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b54493-c4de-458d-af37-fd0b9fd5b7a3 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed44c18e2d14044b161dc3c74b99c9c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:14.306644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b54493-c4de-458d-af37-fd0b9fd5b7a3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:14.308443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 606/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Thu May 26 17:49:14 2022] GET /identity/v3/projects/6ed44c18e2d14044b161dc3c74b99c9c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:14.315944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:49:14.415042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476178c-b778-4f4d-a0ca-4e2b9a1ebb8e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:49:14.444772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:14.450281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c56a-6898-4b73-ad0b-72e802c2e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:49:14.450937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c56a-6898-4b73-ad0b-72e802c2e197 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:49:14.451279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c56a-6898-4b73-ad0b-72e802c2e197 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:49:14.451562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c56a-6898-4b73-ad0b-72e802c2e197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:49:14.452451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c56a-6898-4b73-ad0b-72e802c2e197 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=6ed44c18e2d14044b161dc3c74b99c9c, user.id=f56a1cb425e5462d9694c64a97de423d) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:49:14.452767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c56a-6898-4b73-ad0b-72e802c2e197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:49:14.454930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c56a-6898-4b73-ad0b-72e802c2e197 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:49:14.461132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 594/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:49:14 2022] GET /identity/v3/role_assignments?user.id=f56a1cb425e5462d9694c64a97de423d&scope.project.id=6ed44c18e2d14044b161dc3c74b99c9c&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:49:24.297450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=14 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:49:24.458389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:20.304044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3563f-db59-41f4-9dfa-64d33c803e33 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:20.305129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3563f-db59-41f4-9dfa-64d33c803e33 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:20.305129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3563f-db59-41f4-9dfa-64d33c803e33 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:20.306027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 607/1201] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:50:20.317958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cfe19-d918-41e3-97f9-cf46dd8dd4ed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:20.318529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cfe19-d918-41e3-97f9-cf46dd8dd4ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:20.318955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cfe19-d918-41e3-97f9-cf46dd8dd4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:20.358010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cf6cfe19-d918-41e3-97f9-cf46dd8dd4ed None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:20.359973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cf6cfe19-d918-41e3-97f9-cf46dd8dd4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:20.508562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 595/1202] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:50:20.536984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3563f-db59-41f4-9dfa-64d33c803e33 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:20.708348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3563f-db59-41f4-9dfa-64d33c803e33 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:20.802943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:20.804903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:20.805724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:20.806503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:20.831536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:20.839930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:20.879604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:20.880705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:20.881730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:20.881730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:20.881730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:20.881730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:20.882558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 608/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:50:20.892726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cfe19-d918-41e3-97f9-cf46dd8dd4ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:21.115502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cfe19-d918-41e3-97f9-cf46dd8dd4ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:21.174209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:21.184289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0075ef-1e0a-44df-ba92-6b5d984ba0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:21.186179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0075ef-1e0a-44df-ba92-6b5d984ba0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:21.186954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0075ef-1e0a-44df-ba92-6b5d984ba0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:21.187417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0075ef-1e0a-44df-ba92-6b5d984ba0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:21.189244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0075ef-1e0a-44df-ba92-6b5d984ba0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:21.189438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0075ef-1e0a-44df-ba92-6b5d984ba0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:21.192422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0075ef-1e0a-44df-ba92-6b5d984ba0a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:21.224648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 596/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:21.226154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:21.352645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:21.416497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525328-f39e-4cb7-890c-46054af1b45f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:21.466674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1356df-b76c-4b2b-b21e-d9b416ff2d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:21.467953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1356df-b76c-4b2b-b21e-d9b416ff2d44 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:21.468487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1356df-b76c-4b2b-b21e-d9b416ff2d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:21.469104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1356df-b76c-4b2b-b21e-d9b416ff2d44 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:21.470606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1356df-b76c-4b2b-b21e-d9b416ff2d44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:21.473585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1356df-b76c-4b2b-b21e-d9b416ff2d44 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:21.512259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 609/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Thu May 26 17:50:21 2022] POST /identity/v3/users => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:50:24.378442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ece6e-9015-4477-817b-99f56f778cf9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:24.379053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ece6e-9015-4477-817b-99f56f778cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:24.379350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ece6e-9015-4477-817b-99f56f778cf9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:24.382408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 597/1206] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:50:24.390022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2528-343c-4267-8251-c963ea3e8b32 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:24.390853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2528-343c-4267-8251-c963ea3e8b32 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:24.390853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2528-343c-4267-8251-c963ea3e8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:24.412663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-47de2528-343c-4267-8251-c963ea3e8b32 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:24.414328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-47de2528-343c-4267-8251-c963ea3e8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:24.545484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 610/1207] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:50:24.577058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ece6e-9015-4477-817b-99f56f778cf9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:24.779208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ece6e-9015-4477-817b-99f56f778cf9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:24.851076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:24.852486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:24.853037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:24.853544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:24.876283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:24.892537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:24.893792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:50:24.894701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:24.895403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 598/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:50:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:24.905188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de2528-343c-4267-8251-c963ea3e8b32 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:24.978513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:25.084471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de2528-343c-4267-8251-c963ea3e8b32 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:25.139530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:25.140938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:25.141528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:25.142106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:25.143790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:25.144514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:25.147353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:25.162359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 611/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:50:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:25.172467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:25.290375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:25.402381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9221468-dceb-4ceb-a39d-9e256d3c2042 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:25.472598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:25.474116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:25.474590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:25.475063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:25.496171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:25.499529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:25.535288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:25.537385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:25.539334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:25.539334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:25.539334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:25.539334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:25.539334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 599/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:25.550183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:25.730670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:25.735981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0d69a-8309-4d89-a62e-b7432ffc644e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:25.790023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:25.791682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:25.792312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:25.792789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:25.794383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:25.794958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:25.797671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:25.822268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 612/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:25.828988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:26.003049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a7ffb-190a-4038-80f4-8f086bcead27 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:26.006005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:26.062241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:26.063310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:26.063806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:26.064191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:26.079940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:26.085113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:50:26.104581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:26.107090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:26.109219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:26.113022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 600/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:26.113627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:26.289152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9126dd-4a16-487c-9c7b-bfba7c713f8b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:26.357872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:26.359035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:26.359484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:26.359910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:26.361172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:26.361737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:26.364176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:26.398388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 613/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Thu May 26 17:50:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:26.410979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:26.604991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3eff4-cdd3-4ca0-9620-c2b464af422e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:26.663754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:26.665032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:26.665668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:26.666247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:26.723097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:26.795258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:26.797251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:26.996491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 601/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:50:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:50:27.004202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:27.037706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:27.207248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eb49c-babe-48d1-a061-321e7e90c937 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:27.271600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:27.272596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:27.273027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:27.273435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:27.287461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:27.289126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:27.317341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:27.319451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:27.321547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:27.321547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:27.321547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:27.321547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:27.322516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 614/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:50:27.329385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:27.427044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:27.494739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd477d60-0297-4dec-b37c-e484fd0b057d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:27.577978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:27.578961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:27.579420 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:27.579868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:27.581252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:27.581731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:27.584182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:27.612648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 602/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:27.614808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:27.720663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:27.783688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75afa6-bdb3-4f15-b3de-03f40a444948 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:27.842362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:27.843883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:27.844577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:27.845761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:27.861940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:27.864725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:50:27.896390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:27.897576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:27.898651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:27.904934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 615/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:27.905100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:28.088869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439c57b-6d14-4078-9a4b-4280676f565e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:28.118837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:28.140534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28214f-1e30-4d55-ad28-f29cd5ce2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:28.141230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28214f-1e30-4d55-ad28-f29cd5ce2221 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:28.141512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28214f-1e30-4d55-ad28-f29cd5ce2221 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:28.141788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28214f-1e30-4d55-ad28-f29cd5ce2221 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:28.142652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28214f-1e30-4d55-ad28-f29cd5ce2221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:28.143091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28214f-1e30-4d55-ad28-f29cd5ce2221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:28.144679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28214f-1e30-4d55-ad28-f29cd5ce2221 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:28.162718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 603/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:28.169930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:28.307270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d67e-5046-46f5-abc6-d2f961dc078c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:28.359023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:28.373694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849292c9-a02a-4621-83f9-cb3621808572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:28.374613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849292c9-a02a-4621-83f9-cb3621808572 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:28.375100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849292c9-a02a-4621-83f9-cb3621808572 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:28.375691 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849292c9-a02a-4621-83f9-cb3621808572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:28.377614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849292c9-a02a-4621-83f9-cb3621808572 None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=2071d6186946488aac5df5fe4ab55c56) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:28.378254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849292c9-a02a-4621-83f9-cb3621808572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:28.381714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849292c9-a02a-4621-83f9-cb3621808572 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:28.393007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 616/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:50:28 2022] GET /identity/v3/role_assignments?user.id=2071d6186946488aac5df5fe4ab55c56&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:31.356914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93cc8-8f32-48cc-8781-c96f92a9f1a5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:31.357940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93cc8-8f32-48cc-8781-c96f92a9f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:31.357940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93cc8-8f32-48cc-8781-c96f92a9f1a5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:31.359869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 604/1220] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:50:31.366532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec2c6b-ac3a-4823-9f2f-cb126f1ff460 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:31.367377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec2c6b-ac3a-4823-9f2f-cb126f1ff460 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:31.367545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec2c6b-ac3a-4823-9f2f-cb126f1ff460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:31.387082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4cec2c6b-ac3a-4823-9f2f-cb126f1ff460 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:31.389187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4cec2c6b-ac3a-4823-9f2f-cb126f1ff460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:31.516393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 617/1221] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:50:31.555066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93cc8-8f32-48cc-8781-c96f92a9f1a5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:31.729361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93cc8-8f32-48cc-8781-c96f92a9f1a5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:31.789357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:31.790721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:31.791205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:31.791674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:31.812379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:31.826863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:31.829054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:31.830822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 605/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:50:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:31.837015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec2c6b-ac3a-4823-9f2f-cb126f1ff460 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:31.980809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec2c6b-ac3a-4823-9f2f-cb126f1ff460 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:32.020077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:32.036134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:32.037253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:32.037725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:32.038150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:32.039209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:32.039609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:32.041508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:32.054073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 618/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:50:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:32.062540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:32.126121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:32.224454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e635ff8-8ea1-4fe9-9477-ca119943dd29 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:32.269476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:32.270444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:32.270899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:32.271359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:32.285760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:32.287930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:32.312258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:32.313789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:32.314910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:32.314910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:32.314910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:32.314910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:32.314910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 606/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:50:32.320484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:32.465247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553425fa-10ca-4390-9b16-3786b5c898da None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:32.533967 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:32.535032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:32.535465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:32.535952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:32.537232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:32.537878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:32.540377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:32.560439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 619/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:32.566790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:32.702530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:32.710536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d59d1a-36f6-46e5-9c4e-33ed4bd333e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:32.759014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:32.760250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:32.760902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:32.761817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:32.775887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:32.778094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:50:32.801257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:32.802494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:32.803723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 607/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:32.810914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:32.881908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:32.954380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca5ff-7ff6-43fc-82b0-cc98ce467c34 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:33.023359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:33.024784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:33.025294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:33.025858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:33.027750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:33.028562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:33.031624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:33.072280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 620/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Thu May 26 17:50:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:33.080529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:33.250802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fae0-7268-40a8-8af8-2d2e2c2f303e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:33.330619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:33.332397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:33.333070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:33.333666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:33.358807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:33.362017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:33.399930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:33.401119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:33.402632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:33.402632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:33.402632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:33.402632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:33.403045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 608/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:33.414773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:33.540612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc81e22-21a6-40ca-955d-59930d34239d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:33.544586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:33.591905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:33.592781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:33.593355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:33.593645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:33.594506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:33.594910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:33.596855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:33.611658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 621/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:33.618848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:33.641227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:33.786524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5754-e91e-4de8-ba44-6cd8dc197310 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:33.857874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:33.859204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:33.859676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:33.860225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:33.875196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:33.878025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:50:33.902471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:33.904595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:33.906480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 609/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:33.912660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:34.044573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6acc6-c2cf-48de-975c-34c97e4725ae None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:34.108758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc771fa0-cb0a-4ffe-80f3-a0af2901b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:34.109499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc771fa0-cb0a-4ffe-80f3-a0af2901b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:34.109875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc771fa0-cb0a-4ffe-80f3-a0af2901b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:34.110244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc771fa0-cb0a-4ffe-80f3-a0af2901b3d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:34.111189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc771fa0-cb0a-4ffe-80f3-a0af2901b3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:34.111764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc771fa0-cb0a-4ffe-80f3-a0af2901b3d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:34.114070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc771fa0-cb0a-4ffe-80f3-a0af2901b3d8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:34.133112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 622/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:34.142247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:34.240346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:34.303029 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5192c-ed9d-48d9-a261-1ddd115d5c3d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:34.355899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cdbaa-8bca-4ff0-80cc-02143c9b1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:34.357296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cdbaa-8bca-4ff0-80cc-02143c9b1cb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:34.357663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cdbaa-8bca-4ff0-80cc-02143c9b1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:34.358044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cdbaa-8bca-4ff0-80cc-02143c9b1cb3 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/2071d6186946488aac5df5fe4ab55c56/roles/3f20b0bae044417383cdf3692e11bed6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:34.380668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cdbaa-8bca-4ff0-80cc-02143c9b1cb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=2071d6186946488aac5df5fe4ab55c56, role_id=3f20b0bae044417383cdf3692e11bed6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:34.382484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cdbaa-8bca-4ff0-80cc-02143c9b1cb3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:34.401513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 610/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:50:34 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/2071d6186946488aac5df5fe4ab55c56/roles/3f20b0bae044417383cdf3692e11bed6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:50:37.092515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d8fb-08e5-40d3-8525-c9f441043ef2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:37.093151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d8fb-08e5-40d3-8525-c9f441043ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:37.093151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d8fb-08e5-40d3-8525-c9f441043ef2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:37.095062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 623/1233] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:50:37.104065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e5f32-0dc6-40b3-9618-c93f893038da None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:37.104065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e5f32-0dc6-40b3-9618-c93f893038da None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:37.104065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e5f32-0dc6-40b3-9618-c93f893038da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:37.130353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c6e5f32-0dc6-40b3-9618-c93f893038da None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:37.132331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c6e5f32-0dc6-40b3-9618-c93f893038da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:37.230701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 611/1234] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:50:37.256421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576d8fb-08e5-40d3-8525-c9f441043ef2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:37.295823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:37.402094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576d8fb-08e5-40d3-8525-c9f441043ef2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:37.452868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:37.453771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:37.454216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:37.454527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:37.469484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:37.479188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:37.481931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:37.483767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 624/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Thu May 26 17:50:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:37.491117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e5f32-0dc6-40b3-9618-c93f893038da None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:37.569723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:37.645646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e5f32-0dc6-40b3-9618-c93f893038da None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:37.697716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:37.698489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:37.698861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:37.699298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:37.700839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:37.701445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:37.703183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:37.713396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 612/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Thu May 26 17:50:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:37.720693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:37.862285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:37.894799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023d9c-38f5-408e-8c1c-b327787784cf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:37.937012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:37.937815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:37.938103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:37.938400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:37.950525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:37.951918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:37.971486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:37.973003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:37.974086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:37.974086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:37.974086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:37.974086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:37.976441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 625/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:50:37.978810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:38.114114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e92bab-5fa9-457a-ae19-e311843ce87a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:38.126607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:38.156380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:38.157056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:38.157340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:38.157614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:38.158480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:38.158953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:38.160371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:38.175637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 613/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:38.182477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:38.315283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81c7a-d620-440c-8bab-e125dd03616f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:38.360959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:38.361885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:38.362172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:38.362527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:38.366475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:38.374836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:38.377085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:50:38.394712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:38.396887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:38.399205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 626/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:38.402289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:38.548497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f33df-1e4c-4b2d-bb46-27089afd9d15 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:38.590648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:38.591271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:38.591589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:38.591829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:38.592891 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:38.593373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:38.595083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:38.616701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 614/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Thu May 26 17:50:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:38.624976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:38.747368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1182c0-e884-45e1-ac46-17ea716d0ebe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:38.801950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:38.802623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:38.802911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:38.803191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:38.886746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:38.897984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:38.899642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:39.034619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 627/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:50:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:50:39.035959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:39.075843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:39.181312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560287b-719f-40c3-80c9-c3cad15395e3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:39.222582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:39.223465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:39.223816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:39.224208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:39.236936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:39.238407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:39.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:39.262853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:39.263756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:39.263756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:39.263756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:39.263756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:39.263756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 615/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:39.268523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:39.394038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:39.401046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3fe07-9650-4657-9f26-c93c7edd1266 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:39.443502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:39.444136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:39.444443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:39.444707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:39.445441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:39.445756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:39.450307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:39.467932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 628/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:39.469351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:39.571871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:39.599958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf531a-cdc5-4a8f-b740-e2e974e33ec2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:39.646138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:39.646960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:39.647245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:39.647524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:39.655796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:39.657374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:50:39.675086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:39.677155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:39.679225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 616/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:39.682952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:39.816510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060f69-d3cd-4167-bfcc-c088c8727a78 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:39.869867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ad87a-8c2e-454c-8375-449c6cb97f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:39.871026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad87a-8c2e-454c-8375-449c6cb97f50 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:39.871535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad87a-8c2e-454c-8375-449c6cb97f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:39.872052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad87a-8c2e-454c-8375-449c6cb97f50 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:39.873572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ad87a-8c2e-454c-8375-449c6cb97f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:39.874123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ad87a-8c2e-454c-8375-449c6cb97f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:39.876878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ad87a-8c2e-454c-8375-449c6cb97f50 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:39.895156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 629/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:39.903746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:40.052656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c122973-4958-4ab9-9bee-f04ad50f8a97 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:40.127482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b4aee-d020-4f50-8016-ad2e192ab89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:40.128727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4aee-d020-4f50-8016-ad2e192ab89c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:40.129284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4aee-d020-4f50-8016-ad2e192ab89c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:40.129886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4aee-d020-4f50-8016-ad2e192ab89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:40.131815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b4aee-d020-4f50-8016-ad2e192ab89c None admin] RBAC: Adding query filter params (role.id=3f20b0bae044417383cdf3692e11bed6, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=2071d6186946488aac5df5fe4ab55c56) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:40.132459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b4aee-d020-4f50-8016-ad2e192ab89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:40.135778 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b4aee-d020-4f50-8016-ad2e192ab89c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:40.153730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 617/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:50:39 2022] GET /identity/v3/role_assignments?user.id=2071d6186946488aac5df5fe4ab55c56&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=3f20b0bae044417383cdf3692e11bed6 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:43.594209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382d73-3886-429f-a9c2-bfb8df534dd6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.595075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382d73-3886-429f-a9c2-bfb8df534dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.595075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382d73-3886-429f-a9c2-bfb8df534dd6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.596333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 630/1247] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:50:43.602903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c47a-003c-441d-85e7-7f2d376fcbaa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.603736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c47a-003c-441d-85e7-7f2d376fcbaa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.603736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c47a-003c-441d-85e7-7f2d376fcbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.609644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:43.623702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-45b8c47a-003c-441d-85e7-7f2d376fcbaa None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:43.625002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-45b8c47a-003c-441d-85e7-7f2d376fcbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:43.711593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 618/1248] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:50:43.735981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6382d73-3886-429f-a9c2-bfb8df534dd6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:43.760157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:43.893189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6382d73-3886-429f-a9c2-bfb8df534dd6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:43.940499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:43.941391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.941729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.941971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.959711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:43.967827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:43.972758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:43.974839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 631/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:50:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:43.976639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c47a-003c-441d-85e7-7f2d376fcbaa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:44.131039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c47a-003c-441d-85e7-7f2d376fcbaa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:44.179550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:44.197093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:44.197788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:44.198767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:44.199283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:44.200238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:44.200553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:44.202215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:44.214274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 619/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:44.223548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:44.345296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:44.376392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ad52-ca3d-4cb1-88c2-c22901a07bd3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:44.434323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:44.435705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:44.436270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:44.436725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:44.456432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:44.457954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:44.478374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:44.480647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:44.482517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:44.482517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:44.482517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:44.482517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:44.484927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 632/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:44.486148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:44.626352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8ed7-d524-43a8-9e46-6505613e932f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:44.686372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:44.687484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:44.687957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:44.688576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:44.689288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:44.689683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:44.692429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:44.714663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 620/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:44.721188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:44.877710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1c48-3ebc-4fa2-8f47-ea9f13fb2c62 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:44.920799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:44.931598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:44.933237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:44.933789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:44.934400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:44.950459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:44.953772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:50:44.986251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:44.988487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:44.989911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 633/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:44.999730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:45.100401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:45.187056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1d311-3603-421c-bb94-711aa9a3faee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:45.240419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:45.241132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:45.241476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:45.241813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:45.242799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:45.243213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:45.245511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:45.271524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 621/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Thu May 26 17:50:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:45.279099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:45.443860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec851d6-8c3a-4422-a523-926e089d9550 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:45.505298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:45.506192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:45.506686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:45.507169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:45.599854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:45.617184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:45.618800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:45.759187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 634/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:50:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:50:45.767858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:45.920579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe65db-4145-4dcf-b508-d98a2283d2f0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:45.940092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:45.985381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:45.986724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:45.987215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:45.987746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.006979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:46.009776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:46.044242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:46.045301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:46.046184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:46.046184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:46.046184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:46.046184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:46.046816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 622/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:46.054230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:46.197632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:46.214515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2db33-28a9-4021-8365-6edcce7161e6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:46.262992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:46.263650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.263941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.264284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.265037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:46.265360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:46.266759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:46.280822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 635/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:46.287474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:46.413712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b488a-bb23-450b-9228-a7366983743d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:46.457278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:46.458088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.458376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.458659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.466487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:46.467979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:50:46.487873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:46.489853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:46.491919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 623/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:46.499148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:46.661202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ce5a2-be9a-4d27-aeab-2ab29230e712 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:46.717471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eebad9-820b-4f6f-a618-e7b067585e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:46.718273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eebad9-820b-4f6f-a618-e7b067585e04 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.718767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eebad9-820b-4f6f-a618-e7b067585e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.719090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eebad9-820b-4f6f-a618-e7b067585e04 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.720305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eebad9-820b-4f6f-a618-e7b067585e04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:46.720854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eebad9-820b-4f6f-a618-e7b067585e04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:46.723765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eebad9-820b-4f6f-a618-e7b067585e04 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:46.743694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 636/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:46.753211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:46.788986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:46.912285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406943c0-7920-44be-97f5-eeb521dbabcf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:46.954984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adb74c-1319-40c9-9f7f-39fba703f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:46.955667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb74c-1319-40c9-9f7f-39fba703f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.955958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb74c-1319-40c9-9f7f-39fba703f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.956270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb74c-1319-40c9-9f7f-39fba703f5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.957144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb74c-1319-40c9-9f7f-39fba703f5e3 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=2071d6186946488aac5df5fe4ab55c56) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:46.957462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb74c-1319-40c9-9f7f-39fba703f5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:46.958966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb74c-1319-40c9-9f7f-39fba703f5e3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:46.965659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 624/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:50:46 2022] GET /identity/v3/role_assignments?user.id=2071d6186946488aac5df5fe4ab55c56&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=cde11b02d419404ea30981d75030a0a8 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:49.939936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ff69-f4ca-4020-8335-75ce14ace5c7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:49.940579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ff69-f4ca-4020-8335-75ce14ace5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:49.940579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ff69-f4ca-4020-8335-75ce14ace5c7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:49.941902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 637/1261] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:50:49.947365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0cb58-71ac-4043-b885-00e508d29c42 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:49.948423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0cb58-71ac-4043-b885-00e508d29c42 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:49.948526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0cb58-71ac-4043-b885-00e508d29c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:49.966329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-79b0cb58-71ac-4043-b885-00e508d29c42 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:49.967405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-79b0cb58-71ac-4043-b885-00e508d29c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:50.040501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 625/1262] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:50:50.066870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ff69-f4ca-4020-8335-75ce14ace5c7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:50.078507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:50.185427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ff69-f4ca-4020-8335-75ce14ace5c7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:50.225507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:50.226473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.226761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.227041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.237529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:50.245121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:50.246589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:50.247734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 638/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:50:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:50.252478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0cb58-71ac-4043-b885-00e508d29c42 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:50.272172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:50.361945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0cb58-71ac-4043-b885-00e508d29c42 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:50.404490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:50.405204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.405481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.405759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.406538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:50.406844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:50.408323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:50.418806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 626/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:50:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:50.425157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:50.520761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:50.560900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9871c-0c74-4d1a-b312-e6893b4084f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:50.601979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:50.602786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.603073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.603344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.615270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:50.616697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:50.639117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:50.640370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:50.641327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:50.641327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:50.641327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:50.641327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:50.641327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 639/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:50.648848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:50.745823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:50.770181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd82b-3433-4a73-af7d-53e92d5dbba5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:50.805180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:50.805852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.806136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.806413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.807752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:50.808087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:50.809522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:50.823266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 627/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:50.829268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:50.935404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e443e22-e05c-45db-b052-963498b3698e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:50.957092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:50.972393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:50.973216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.973505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.973787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.983139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:50.984847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:50:51.000940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:51.002415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:51.004325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 640/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:51.008146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.118337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15973a5-79ef-4e68-abdf-9a8f02d93691 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.155772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.156499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.156787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.157065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.157948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:51.158266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.159782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.171294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:51.182265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 628/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:51.188639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.325656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2028bd1-2120-4238-a37b-73f259aa5021 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.363437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.364291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.364584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.364867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.378355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.380173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:51.401961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:51.403593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:51.405409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:51.405409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:51.405409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:51.405409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:51.405409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 641/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:51.410120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.605450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb773-d09d-48a1-bde5-634cfa21b743 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.669414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.670163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.670497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.670824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.671631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:51.671991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.673514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.686586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 629/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:51.692654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.727247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:51.814901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c1e8-8ea5-49d2-97f2-0eea96e76654 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.853069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.854007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.854300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.854572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.862346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.863728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:50:51.880171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:51.881938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:51.883983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 642/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:51.889694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.977679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:52.027031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a08476-ce0f-44bb-a0eb-6b41ad9a6498 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:52.064240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b27241-f722-432c-a39b-2ae04395d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:52.064922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b27241-f722-432c-a39b-2ae04395d46a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:52.065217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b27241-f722-432c-a39b-2ae04395d46a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:52.065502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b27241-f722-432c-a39b-2ae04395d46a None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:52.066310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b27241-f722-432c-a39b-2ae04395d46a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:52.066629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b27241-f722-432c-a39b-2ae04395d46a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:52.068134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b27241-f722-432c-a39b-2ae04395d46a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:52.082225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 630/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:52.089064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:52.190637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:52.201425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714cdac-a213-4179-a4a2-b6fc15de9e2c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:52.239083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f471a5-9d54-4579-a859-6583afcab750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:52.240062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f471a5-9d54-4579-a859-6583afcab750 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:52.240345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f471a5-9d54-4579-a859-6583afcab750 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:52.240630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f471a5-9d54-4579-a859-6583afcab750 None admin] PATH_INFO: `/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/2071d6186946488aac5df5fe4ab55c56/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:52.242845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f471a5-9d54-4579-a859-6583afcab750 None admin] RBAC: Authorizing `identity:create_grant(project_id=4002e0cc7fbc4d27be081dc3e65f038f, user_id=2071d6186946488aac5df5fe4ab55c56, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:52.244434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f471a5-9d54-4579-a859-6583afcab750 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:52.258960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 643/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Thu May 26 17:50:52 2022] PUT /identity/v3/projects/4002e0cc7fbc4d27be081dc3e65f038f/users/2071d6186946488aac5df5fe4ab55c56/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:50:54.626670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9dc60-7031-4695-928c-2f54742ca5b7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:54.627245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9dc60-7031-4695-928c-2f54742ca5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:54.627245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9dc60-7031-4695-928c-2f54742ca5b7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:54.628789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 631/1274] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:50:54.634635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314517e-98c0-41c7-ab68-58236823e0f1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:54.635215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314517e-98c0-41c7-ab68-58236823e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:54.635215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314517e-98c0-41c7-ab68-58236823e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:54.653230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3314517e-98c0-41c7-ab68-58236823e0f1 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:54.654451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3314517e-98c0-41c7-ab68-58236823e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:54.730789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 644/1275] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:50:54.756254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9dc60-7031-4695-928c-2f54742ca5b7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:54.921566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9dc60-7031-4695-928c-2f54742ca5b7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:54.941604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:54.961636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3db654-9faa-4053-a450-da608174081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:54.962446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3db654-9faa-4053-a450-da608174081c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:54.962729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3db654-9faa-4053-a450-da608174081c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:54.963547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3db654-9faa-4053-a450-da608174081c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:54.977661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3db654-9faa-4053-a450-da608174081c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8b3db654-9faa-4053-a450-da608174081c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:54.986416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:54.987619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:54.988806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 632/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Thu May 26 17:50:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:54.994656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314517e-98c0-41c7-ab68-58236823e0f1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:55.080761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:55.100648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314517e-98c0-41c7-ab68-58236823e0f1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:55.136669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:55.137599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:55.137881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:55.138154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:55.138913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:55.139220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:55.140630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:55.149341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 645/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Thu May 26 17:50:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:55.157925 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3db654-9faa-4053-a450-da608174081c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:55.269778 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3db654-9faa-4053-a450-da608174081c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:55.305489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:55.306288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:55.306574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:55.307612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:55.319063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:55.320593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:55.338352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:55.340202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:55.341918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:55.341918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:55.341918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:55.341918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:55.341918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 633/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:55.345423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:55.454686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388eac26-6475-4266-b957-3c93ca925879 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:55.499743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:55.500621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:55.500907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:55.501198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:55.502028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:55.502357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:55.503941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:55.519246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 646/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:55.530316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:55.570306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:55.649969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770ae3-7d76-4e65-bcc9-5b063caea9c1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:55.686931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:55.687741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:55.688042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:55.688329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:55.696286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:55.697952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:50:55.712591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:55.714859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:55.715853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 634/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:50:55.720613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:55.724766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:55.830308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5444-0436-432a-88ae-b2b93e0bfea2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:55.866048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:55.866736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:55.867020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:55.867304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:55.868184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:55.868502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:55.870090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:55.888357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 647/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Thu May 26 17:50:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:55.894204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:55.989571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:56.000348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c978-8077-4de0-951c-1f8e8cf69f9e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:56.035545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:56.036228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:56.036521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:56.036804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:56.109099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:56.110489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:56.210276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:56.222259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 635/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Thu May 26 17:50:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:50:56.228269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:56.296521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:56.337098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281821e-90cf-4690-8753-9746f6d26eee None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:56.372870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:56.373594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:56.373882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:56.374161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:56.384654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:56.386137 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:56.405203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:56.406521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:56.407740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:56.407740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:56.407740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:56.407740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:56.407740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 648/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:56.412525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:56.525936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd1eef-a087-4c16-8e4e-ebd0deaf8453 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:56.566811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:56.567505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:56.567795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:56.568108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:56.568867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:56.569180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:56.570620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:56.583879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 636/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Thu May 26 17:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:56.590507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:56.711611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9f08-cfc7-4358-819c-93c29e3ea9d0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:56.727434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:56.754744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:56.755565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:56.755850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:56.756169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:56.764268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:56.765926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:50:56.780788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:56.782734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 26 17:50:56.784990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 649/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Thu May 26 17:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:56.788894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:56.857708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:56.912252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763716bd-a733-4af9-874b-7c663564a5c2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:56.948994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09120b23-b7e4-493e-bb84-26684e1c8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:56.949765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09120b23-b7e4-493e-bb84-26684e1c8565 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:56.950110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09120b23-b7e4-493e-bb84-26684e1c8565 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:56.950482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09120b23-b7e4-493e-bb84-26684e1c8565 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:56.951299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09120b23-b7e4-493e-bb84-26684e1c8565 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:56.951616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09120b23-b7e4-493e-bb84-26684e1c8565 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:56.953117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09120b23-b7e4-493e-bb84-26684e1c8565 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:56.967198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 637/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Thu May 26 17:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:56.977704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:57.125662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822a48b-1e1b-40ac-89ac-723e400d23d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:57.160819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd63b83-7b23-4d02-940a-fe297341c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:57.161574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd63b83-7b23-4d02-940a-fe297341c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:57.161900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd63b83-7b23-4d02-940a-fe297341c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:57.162213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd63b83-7b23-4d02-940a-fe297341c1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:57.163155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd63b83-7b23-4d02-940a-fe297341c1e9 None admin] RBAC: Adding query filter params (role.id=cde11b02d419404ea30981d75030a0a8, scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f, user.id=2071d6186946488aac5df5fe4ab55c56) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:57.163535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd63b83-7b23-4d02-940a-fe297341c1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:57.165156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd63b83-7b23-4d02-940a-fe297341c1e9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:57.172913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 650/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Thu May 26 17:50:56 2022] GET /identity/v3/role_assignments?user.id=2071d6186946488aac5df5fe4ab55c56&scope.project.id=4002e0cc7fbc4d27be081dc3e65f038f&role.id=cde11b02d419404ea30981d75030a0a8 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:59.512585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bbf49-467e-4689-bcb5-3654dfd208a4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.513211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bbf49-467e-4689-bcb5-3654dfd208a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.513317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bbf49-467e-4689-bcb5-3654dfd208a4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.514997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 638/1288] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:50:59.522253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3762d6-1290-4abd-bc44-101e4c93895d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.522847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3762d6-1290-4abd-bc44-101e4c93895d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.522968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3762d6-1290-4abd-bc44-101e4c93895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.546969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bc3762d6-1290-4abd-bc44-101e4c93895d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:59.548506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bc3762d6-1290-4abd-bc44-101e4c93895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:59.595601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.644528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 651/1289] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:50:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:50:59.667436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bbf49-467e-4689-bcb5-3654dfd208a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.815103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bbf49-467e-4689-bcb5-3654dfd208a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.827075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.853045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.854390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.854893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.855182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.855860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.857297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:59.870507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:59.872578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:50:59.873717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 639/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:59.881457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3762d6-1290-4abd-bc44-101e4c93895d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.989391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3762d6-1290-4abd-bc44-101e4c93895d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.027064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2d6f6-5b04-48ab-80ac-6cea52e0fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.027751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2d6f6-5b04-48ab-80ac-6cea52e0fe94 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.028074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2d6f6-5b04-48ab-80ac-6cea52e0fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.028363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2d6f6-5b04-48ab-80ac-6cea52e0fe94 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.029093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2d6f6-5b04-48ab-80ac-6cea52e0fe94 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:00.029410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2d6f6-5b04-48ab-80ac-6cea52e0fe94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.030802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2d6f6-5b04-48ab-80ac-6cea52e0fe94 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.036668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 652/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:00.043294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:00.156102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c76d-24aa-4616-baf3-7d6ce2a471e2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.195148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d63d4-3ea1-4dea-a2b8-5bbeb92374d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.195825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d63d4-3ea1-4dea-a2b8-5bbeb92374d7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.196147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d63d4-3ea1-4dea-a2b8-5bbeb92374d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.196429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d63d4-3ea1-4dea-a2b8-5bbeb92374d7 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.197240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d63d4-3ea1-4dea-a2b8-5bbeb92374d7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:00.197680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d63d4-3ea1-4dea-a2b8-5bbeb92374d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.199096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d63d4-3ea1-4dea-a2b8-5bbeb92374d7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.204676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 640/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Thu May 26 17:51:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:02.562335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af381b5-4630-4074-a9a5-b04277d92260 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:02.562933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af381b5-4630-4074-a9a5-b04277d92260 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:02.562933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af381b5-4630-4074-a9a5-b04277d92260 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:02.564338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 653/1293] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:51:02.570817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ddd3e-0fc5-4da3-9db0-292933608f9f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:02.571354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ddd3e-0fc5-4da3-9db0-292933608f9f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:02.571618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ddd3e-0fc5-4da3-9db0-292933608f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:02.596565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8b6ddd3e-0fc5-4da3-9db0-292933608f9f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:02.597828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8b6ddd3e-0fc5-4da3-9db0-292933608f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:02.631182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:02.672719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 641/1294] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:51:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:51:02.696495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af381b5-4630-4074-a9a5-b04277d92260 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:02.731981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:02.817717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af381b5-4630-4074-a9a5-b04277d92260 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:02.853863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb819d-e135-497a-93af-7095795cb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:02.854834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb819d-e135-497a-93af-7095795cb4b1 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:02.855120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb819d-e135-497a-93af-7095795cb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:02.855397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb819d-e135-497a-93af-7095795cb4b1 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:02.856175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb819d-e135-497a-93af-7095795cb4b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:02.857591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb819d-e135-497a-93af-7095795cb4b1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:02.876402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 654/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Thu May 26 17:51:02 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:05.269918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f9d1-8050-4043-aa8e-5f9b9720d206 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.270501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f9d1-8050-4043-aa8e-5f9b9720d206 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.270501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f9d1-8050-4043-aa8e-5f9b9720d206 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.271970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 642/1296] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:51:05.279248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c8fc-af0c-4609-8b1a-79aa7a6f1fc1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.279709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c8fc-af0c-4609-8b1a-79aa7a6f1fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.279814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c8fc-af0c-4609-8b1a-79aa7a6f1fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.297293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d9c1c8fc-af0c-4609-8b1a-79aa7a6f1fc1 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:05.298490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9c1c8fc-af0c-4609-8b1a-79aa7a6f1fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:05.381643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 655/1297] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:51:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:51:05.410125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f9d1-8050-4043-aa8e-5f9b9720d206 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.522149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f9d1-8050-4043-aa8e-5f9b9720d206 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.560346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.561241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.561523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.561802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.562467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.563869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:05.576964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:05.578459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:51:05.579383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 643/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:05.584524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1c8fc-af0c-4609-8b1a-79aa7a6f1fc1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.603362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.685305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1c8fc-af0c-4609-8b1a-79aa7a6f1fc1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.720566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.721228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.721511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.721790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.722516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:05.722828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.724229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.730604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 656/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.737810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.787748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.870518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d656a8-7326-44e9-ab76-f93b62b2e370 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.906663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41083b55-8472-47c0-9b87-b06498bdd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.907324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083b55-8472-47c0-9b87-b06498bdd068 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.907607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083b55-8472-47c0-9b87-b06498bdd068 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.907880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083b55-8472-47c0-9b87-b06498bdd068 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.908707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41083b55-8472-47c0-9b87-b06498bdd068 None admin] RBAC: Adding query filter params (interface=public, service_id=6fc38f03a5c04fecbf13ef845f94ecc2, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:05.909020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41083b55-8472-47c0-9b87-b06498bdd068 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.910393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41083b55-8472-47c0-9b87-b06498bdd068 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.916791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 644/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/endpoints?service_id=6fc38f03a5c04fecbf13ef845f94ecc2&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.922383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:06.012849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:06.042295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826e7b4-8c44-4ee1-b1f8-58d9a306058d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.100995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2255c81-2cfb-4c08-b5fe-cca6036494bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.102141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2255c81-2cfb-4c08-b5fe-cca6036494bd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.102666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2255c81-2cfb-4c08-b5fe-cca6036494bd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.103860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2255c81-2cfb-4c08-b5fe-cca6036494bd None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.104879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2255c81-2cfb-4c08-b5fe-cca6036494bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.107504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2255c81-2cfb-4c08-b5fe-cca6036494bd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.121248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 657/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/services => generated 2191 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:51:08.477256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc92f3-1cf2-4387-8e17-559916581e64 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.477956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc92f3-1cf2-4387-8e17-559916581e64 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.477956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc92f3-1cf2-4387-8e17-559916581e64 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.479411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 645/1302] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:51:08.487072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c68ab-55df-4862-a5c3-0627b5a91382 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.487609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c68ab-55df-4862-a5c3-0627b5a91382 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.487609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c68ab-55df-4862-a5c3-0627b5a91382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.507267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-829c68ab-55df-4862-a5c3-0627b5a91382 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:08.509790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-829c68ab-55df-4862-a5c3-0627b5a91382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:08.590546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 658/1303] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:51:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:51:08.614084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc92f3-1cf2-4387-8e17-559916581e64 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.735442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:08.747098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc92f3-1cf2-4387-8e17-559916581e64 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:08.810608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:08.812002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.812551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.813046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.814283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:08.816904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:08.842147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:08.845266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 26 17:51:08.846941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 646/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Thu May 26 17:51:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:08.850862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c68ab-55df-4862-a5c3-0627b5a91382 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.973665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:09.023179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c68ab-55df-4862-a5c3-0627b5a91382 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:09.076733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ae0f-389d-4ec8-9b66-b0ea73c09c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:09.077835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ae0f-389d-4ec8-9b66-b0ea73c09c05 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:09.078321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ae0f-389d-4ec8-9b66-b0ea73c09c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:09.078787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ae0f-389d-4ec8-9b66-b0ea73c09c05 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:09.080063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472ae0f-389d-4ec8-9b66-b0ea73c09c05 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:09.080592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472ae0f-389d-4ec8-9b66-b0ea73c09c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:09.082727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472ae0f-389d-4ec8-9b66-b0ea73c09c05 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:09.088982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 659/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Thu May 26 17:51:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:09.095096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:09.232449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e29e8f-247e-4fb2-9994-a7aa19c8f338 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:09.272132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5947ac-c6b9-40f5-bc7e-27aa42952116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:09.272797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5947ac-c6b9-40f5-bc7e-27aa42952116 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:09.273079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5947ac-c6b9-40f5-bc7e-27aa42952116 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:09.273404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5947ac-c6b9-40f5-bc7e-27aa42952116 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:09.274117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5947ac-c6b9-40f5-bc7e-27aa42952116 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:09.275550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5947ac-c6b9-40f5-bc7e-27aa42952116 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:09.299085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 647/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Thu May 26 17:51:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:19.085534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=30 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:19.294424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:20.794862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea559d-977f-4cef-9394-e2cf85959383 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.795452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea559d-977f-4cef-9394-e2cf85959383 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.795534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea559d-977f-4cef-9394-e2cf85959383 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.803299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a212e-c6ff-4b1a-89b8-00497f65c828 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.803808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a212e-c6ff-4b1a-89b8-00497f65c828 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.803895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a212e-c6ff-4b1a-89b8-00497f65c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.807311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 660/1307] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:20.891636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9c8a212e-c6ff-4b1a-89b8-00497f65c828 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:20.893231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9c8a212e-c6ff-4b1a-89b8-00497f65c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:21.027037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 648/1308] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:21.079611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2ea6e-6896-4b00-a97e-ee09048ec93b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.079933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2ea6e-6896-4b00-a97e-ee09048ec93b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.080216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2ea6e-6896-4b00-a97e-ee09048ec93b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.081915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 661/1309] 10.222.0.69 () {54 vars in 964 bytes} [Thu May 26 17:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:21.088293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4dd2-c0ca-4551-b5a5-e2db7fc83475 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.088581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4dd2-c0ca-4551-b5a5-e2db7fc83475 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.088863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4dd2-c0ca-4551-b5a5-e2db7fc83475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.194587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-321b4dd2-c0ca-4551-b5a5-e2db7fc83475 None None] MFA Rules not processed for user `eadb39271321475ebb10382db43db0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:21.196498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-321b4dd2-c0ca-4551-b5a5-e2db7fc83475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:21.221675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.310486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 649/1310] 10.222.0.69 () {58 vars in 1061 bytes} [Thu May 26 17:52:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:21.320159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2ea6e-6896-4b00-a97e-ee09048ec93b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.321886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c5d2ea6e-6896-4b00-a97e-ee09048ec93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:21.453036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2ea6e-6896-4b00-a97e-ee09048ec93b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:21.543348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514fad-d8f1-44d1-bbbe-d6bc7b059a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:21.543982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514fad-d8f1-44d1-bbbe-d6bc7b059a4f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.544300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514fad-d8f1-44d1-bbbe-d6bc7b059a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.544582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514fad-d8f1-44d1-bbbe-d6bc7b059a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.546358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-77514fad-d8f1-44d1-bbbe-d6bc7b059a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:21.615267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.684062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77514fad-d8f1-44d1-bbbe-d6bc7b059a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:21.685554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77514fad-d8f1-44d1-bbbe-d6bc7b059a4f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:21.709631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 662/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:24.265428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ff09-bec2-4f1c-a26d-8955dfd1612b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.265942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ff09-bec2-4f1c-a26d-8955dfd1612b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.265942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ff09-bec2-4f1c-a26d-8955dfd1612b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.274044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83abc2-c01a-4499-bfe8-41d28bfe45ca None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.274642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83abc2-c01a-4499-bfe8-41d28bfe45ca None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.274642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83abc2-c01a-4499-bfe8-41d28bfe45ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.277640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 650/1312] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:24.373620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8c83abc2-c01a-4499-bfe8-41d28bfe45ca None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:24.375132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8c83abc2-c01a-4499-bfe8-41d28bfe45ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:24.494283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 663/1313] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:24.533135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ff09-bec2-4f1c-a26d-8955dfd1612b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:24.534921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d03ff09-bec2-4f1c-a26d-8955dfd1612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:24.652721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ff09-bec2-4f1c-a26d-8955dfd1612b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.741764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:24.744960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d48114-bc4f-4038-bb46-cb653c14733b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.746000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48114-bc4f-4038-bb46-cb653c14733b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.746694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48114-bc4f-4038-bb46-cb653c14733b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.747208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48114-bc4f-4038-bb46-cb653c14733b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.751304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4d48114-bc4f-4038-bb46-cb653c14733b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:24.913271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d48114-bc4f-4038-bb46-cb653c14733b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.915003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d48114-bc4f-4038-bb46-cb653c14733b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:24.949981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 651/1314] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:27.583290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f553-b201-4e57-a874-4d29e750baf5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.583833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f553-b201-4e57-a874-4d29e750baf5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.583833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f553-b201-4e57-a874-4d29e750baf5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.585265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 664/1315] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:27.590780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705ce3c-acbb-4fde-8ee2-bb80081cdc0e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.591243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705ce3c-acbb-4fde-8ee2-bb80081cdc0e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.591355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705ce3c-acbb-4fde-8ee2-bb80081cdc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.657650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1705ce3c-acbb-4fde-8ee2-bb80081cdc0e None None] MFA Rules not processed for user `72e4b3d78f46430da67a9fbd46755937`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:27.658868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1705ce3c-acbb-4fde-8ee2-bb80081cdc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:27.711856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:27.758800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 652/1316] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:27.819769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805124-9114-4b26-9950-42ef0e2549eb None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.820094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805124-9114-4b26-9950-42ef0e2549eb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.820379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805124-9114-4b26-9950-42ef0e2549eb None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.821809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 665/1317] 10.222.0.69 () {54 vars in 964 bytes} [Thu May 26 17:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:27.828414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d46c-e729-4b50-8832-22662cc61ef8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.828707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d46c-e729-4b50-8832-22662cc61ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.828988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d46c-e729-4b50-8832-22662cc61ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.910845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f307d46c-e729-4b50-8832-22662cc61ef8 None None] MFA Rules not processed for user `eadb39271321475ebb10382db43db0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:27.912115 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f307d46c-e729-4b50-8832-22662cc61ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:27.992550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 653/1318] 10.222.0.69 () {58 vars in 1061 bytes} [Thu May 26 17:52:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:28.001725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70805124-9114-4b26-9950-42ef0e2549eb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.003301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-70805124-9114-4b26-9950-42ef0e2549eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:28.013959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:28.108652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70805124-9114-4b26-9950-42ef0e2549eb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:28.183199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a95c6-7fe7-4bd6-8d9c-260d2aacf5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:28.183851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a95c6-7fe7-4bd6-8d9c-260d2aacf5de service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.184169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a95c6-7fe7-4bd6-8d9c-260d2aacf5de service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.184451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a95c6-7fe7-4bd6-8d9c-260d2aacf5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.186124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b7a95c6-7fe7-4bd6-8d9c-260d2aacf5de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:28.250102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:28.298917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a95c6-7fe7-4bd6-8d9c-260d2aacf5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:28.300313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a95c6-7fe7-4bd6-8d9c-260d2aacf5de service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:28.319398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 666/1319] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:52:31.485479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cdc13-57a6-4a19-8791-009a2cd57d27 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.486022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cdc13-57a6-4a19-8791-009a2cd57d27 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.486022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cdc13-57a6-4a19-8791-009a2cd57d27 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.487461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 654/1320] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:31.494310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af693e-3de1-4067-b8b4-8f8d02e3779a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.494762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af693e-3de1-4067-b8b4-8f8d02e3779a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.495064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af693e-3de1-4067-b8b4-8f8d02e3779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.561680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-03af693e-3de1-4067-b8b4-8f8d02e3779a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:31.562908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-03af693e-3de1-4067-b8b4-8f8d02e3779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:31.659184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 667/1321] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:52:31.698926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cdc13-57a6-4a19-8791-009a2cd57d27 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.700540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1e2cdc13-57a6-4a19-8791-009a2cd57d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:31.753654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.808175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cdc13-57a6-4a19-8791-009a2cd57d27 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.884471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a68ab-a29c-4d6b-9368-10f3ea5d39d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.885120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a68ab-a29c-4d6b-9368-10f3ea5d39d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.885407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a68ab-a29c-4d6b-9368-10f3ea5d39d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.885689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a68ab-a29c-4d6b-9368-10f3ea5d39d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.887352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-618a68ab-a29c-4d6b-9368-10f3ea5d39d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:31.984332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.999182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a68ab-a29c-4d6b-9368-10f3ea5d39d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.000670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a68ab-a29c-4d6b-9368-10f3ea5d39d2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.019584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 655/1322] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:34.995421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce11f9-6a87-46b7-acdd-ffc61f780b07 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.995957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce11f9-6a87-46b7-acdd-ffc61f780b07 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.995957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce11f9-6a87-46b7-acdd-ffc61f780b07 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.997404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 668/1323] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:35.002679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31f1b-fb7a-4f71-a40d-567fa5134ee4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.003149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31f1b-fb7a-4f71-a40d-567fa5134ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.003428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31f1b-fb7a-4f71-a40d-567fa5134ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.070542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-70b31f1b-fb7a-4f71-a40d-567fa5134ee4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:35.071858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-70b31f1b-fb7a-4f71-a40d-567fa5134ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:35.169986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 656/1324] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:35.206371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce11f9-6a87-46b7-acdd-ffc61f780b07 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.208795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b2ce11f9-6a87-46b7-acdd-ffc61f780b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:35.234879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.328675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce11f9-6a87-46b7-acdd-ffc61f780b07 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.402337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947d6dd-ab55-4a85-bf33-5301d44c79cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.402986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947d6dd-ab55-4a85-bf33-5301d44c79cf service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.403270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947d6dd-ab55-4a85-bf33-5301d44c79cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.403547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947d6dd-ab55-4a85-bf33-5301d44c79cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.405246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c947d6dd-ab55-4a85-bf33-5301d44c79cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:35.477275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.520141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947d6dd-ab55-4a85-bf33-5301d44c79cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.523627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947d6dd-ab55-4a85-bf33-5301d44c79cf service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.540186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 669/1325] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:37.858879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d928d6-e20e-4a3a-b291-21ef0b4c32b8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.859391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d928d6-e20e-4a3a-b291-21ef0b4c32b8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.859391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d928d6-e20e-4a3a-b291-21ef0b4c32b8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.860771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 657/1326] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:37.866504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c640-44ca-4472-908e-be7e1218ad1f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.866989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c640-44ca-4472-908e-be7e1218ad1f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.867227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c640-44ca-4472-908e-be7e1218ad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.935735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-db59c640-44ca-4472-908e-be7e1218ad1f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:37.937058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-db59c640-44ca-4472-908e-be7e1218ad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:38.036432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 670/1327] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:38.072452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d928d6-e20e-4a3a-b291-21ef0b4c32b8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.074007 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-29d928d6-e20e-4a3a-b291-21ef0b4c32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:38.173559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.218569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d928d6-e20e-4a3a-b291-21ef0b4c32b8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.294967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033eb9d-2399-484c-91d9-0cb110acc35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.295617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033eb9d-2399-484c-91d9-0cb110acc35e service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.295898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033eb9d-2399-484c-91d9-0cb110acc35e service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.296198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033eb9d-2399-484c-91d9-0cb110acc35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.297850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d033eb9d-2399-484c-91d9-0cb110acc35e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:38.410855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.413615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033eb9d-2399-484c-91d9-0cb110acc35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.415594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033eb9d-2399-484c-91d9-0cb110acc35e service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.435084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 658/1328] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:40.782168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a491-5aed-4faa-8ab9-7b2430186936 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.782712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a491-5aed-4faa-8ab9-7b2430186936 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.782887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a491-5aed-4faa-8ab9-7b2430186936 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.784398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 671/1329] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:40.791083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbad2-6652-4182-9bd8-a354cf83d4b7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.791786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbad2-6652-4182-9bd8-a354cf83d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.791786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbad2-6652-4182-9bd8-a354cf83d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.869057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-330cbad2-6652-4182-9bd8-a354cf83d4b7 None None] MFA Rules not processed for user `72e4b3d78f46430da67a9fbd46755937`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:40.870306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-330cbad2-6652-4182-9bd8-a354cf83d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:40.987389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 659/1330] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:41.028144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a491-5aed-4faa-8ab9-7b2430186936 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:41.029747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b42a491-5aed-4faa-8ab9-7b2430186936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:41.061969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:41.140140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a491-5aed-4faa-8ab9-7b2430186936 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.214469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d75e6-bf5c-462a-a3bf-4ad403b9971a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:41.215131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d75e6-bf5c-462a-a3bf-4ad403b9971a service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.215410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d75e6-bf5c-462a-a3bf-4ad403b9971a service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.215684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d75e6-bf5c-462a-a3bf-4ad403b9971a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.217378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-226d75e6-bf5c-462a-a3bf-4ad403b9971a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:41.297549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:41.331094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d75e6-bf5c-462a-a3bf-4ad403b9971a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:41.333602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d75e6-bf5c-462a-a3bf-4ad403b9971a service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:41.352609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 672/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:43.903292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43a8b-eb11-4fbd-8cb3-b254f3d95def None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.903753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43a8b-eb11-4fbd-8cb3-b254f3d95def None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.904112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43a8b-eb11-4fbd-8cb3-b254f3d95def None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.905561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 660/1332] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:43.912942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5784-a53f-4103-9ca9-3646870f7db7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.913454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5784-a53f-4103-9ca9-3646870f7db7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.913543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5784-a53f-4103-9ca9-3646870f7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.994624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-17ce5784-a53f-4103-9ca9-3646870f7db7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:43.996124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-17ce5784-a53f-4103-9ca9-3646870f7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:44.104986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 673/1333] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:44.141365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf43a8b-eb11-4fbd-8cb3-b254f3d95def None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:44.143259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dbf43a8b-eb11-4fbd-8cb3-b254f3d95def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:44.216682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:44.254228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf43a8b-eb11-4fbd-8cb3-b254f3d95def None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:44.332785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bd6e4-e3f9-4279-9e49-823a6c254e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:44.333464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd6e4-e3f9-4279-9e49-823a6c254e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.333735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd6e4-e3f9-4279-9e49-823a6c254e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.334010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd6e4-e3f9-4279-9e49-823a6c254e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.335700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-646bd6e4-e3f9-4279-9e49-823a6c254e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:44.455698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bd6e4-e3f9-4279-9e49-823a6c254e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:44.457864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bd6e4-e3f9-4279-9e49-823a6c254e25 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:44.469277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:44.482034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 661/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:46.809617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e4dd-9224-460e-8727-3db86c69b6ff None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.810177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e4dd-9224-460e-8727-3db86c69b6ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.810177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e4dd-9224-460e-8727-3db86c69b6ff None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.811641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 674/1335] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:46.817557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705bec-b10d-44bb-89c6-2df82d1725e7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.818000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705bec-b10d-44bb-89c6-2df82d1725e7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.818093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705bec-b10d-44bb-89c6-2df82d1725e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.885515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f0705bec-b10d-44bb-89c6-2df82d1725e7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:46.886753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f0705bec-b10d-44bb-89c6-2df82d1725e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:46.994818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 662/1336] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:47.036023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e4dd-9224-460e-8727-3db86c69b6ff None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:47.037615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9b14e4dd-9224-460e-8727-3db86c69b6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:47.079108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:47.148181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e4dd-9224-460e-8727-3db86c69b6ff None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:47.225155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7f801-78fb-48aa-bcd6-ccef6f4eb289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:47.225816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f801-78fb-48aa-bcd6-ccef6f4eb289 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.226102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f801-78fb-48aa-bcd6-ccef6f4eb289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.226385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f801-78fb-48aa-bcd6-ccef6f4eb289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.228124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-31d7f801-78fb-48aa-bcd6-ccef6f4eb289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:47.315360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:47.341849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7f801-78fb-48aa-bcd6-ccef6f4eb289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:47.343300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7f801-78fb-48aa-bcd6-ccef6f4eb289 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:47.361871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 675/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:49.966611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa2dc9-c117-4ddb-9fc6-88f01cc70805 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:49.967285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa2dc9-c117-4ddb-9fc6-88f01cc70805 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:49.967285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa2dc9-c117-4ddb-9fc6-88f01cc70805 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:49.968573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 663/1338] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:49.974479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09a52-6d5e-4e6e-ac9a-321ddc956128 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:49.974930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09a52-6d5e-4e6e-ac9a-321ddc956128 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:49.975032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09a52-6d5e-4e6e-ac9a-321ddc956128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.041080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2eb09a52-6d5e-4e6e-ac9a-321ddc956128 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:50.042202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2eb09a52-6d5e-4e6e-ac9a-321ddc956128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:50.139402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 676/1339] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:50.175899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa2dc9-c117-4ddb-9fc6-88f01cc70805 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.177556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5daa2dc9-c117-4ddb-9fc6-88f01cc70805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:50.258323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:50.288354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa2dc9-c117-4ddb-9fc6-88f01cc70805 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.364233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991f0ae-5dc0-41ef-8152-20de5b96b7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.364797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991f0ae-5dc0-41ef-8152-20de5b96b7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.365092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991f0ae-5dc0-41ef-8152-20de5b96b7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.365390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991f0ae-5dc0-41ef-8152-20de5b96b7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.367045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e991f0ae-5dc0-41ef-8152-20de5b96b7b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:50.482045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991f0ae-5dc0-41ef-8152-20de5b96b7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.483506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991f0ae-5dc0-41ef-8152-20de5b96b7b2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.505983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 664/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:54.747963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218077bd-9c14-479a-9356-d583d2d0f340 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.748553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218077bd-9c14-479a-9356-d583d2d0f340 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.748553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218077bd-9c14-479a-9356-d583d2d0f340 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.750147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 677/1341] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:54.756468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80022cc-7a91-4d8e-9b13-ecb9795ee580 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.757209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80022cc-7a91-4d8e-9b13-ecb9795ee580 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.757293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80022cc-7a91-4d8e-9b13-ecb9795ee580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.764165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:54.836841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f80022cc-7a91-4d8e-9b13-ecb9795ee580 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:54.837974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f80022cc-7a91-4d8e-9b13-ecb9795ee580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:54.953011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 665/1342] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:54.993153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218077bd-9c14-479a-9356-d583d2d0f340 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:54.995819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-218077bd-9c14-479a-9356-d583d2d0f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:55.050233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:55.102177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218077bd-9c14-479a-9356-d583d2d0f340 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.105994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fa686-e97a-44d5-bc6c-37c00c575963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.106643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fa686-e97a-44d5-bc6c-37c00c575963 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.106927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fa686-e97a-44d5-bc6c-37c00c575963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.107232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fa686-e97a-44d5-bc6c-37c00c575963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.117721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fa686-e97a-44d5-bc6c-37c00c575963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.119185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fa686-e97a-44d5-bc6c-37c00c575963 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.129914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 678/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:52:58.020289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26436c3e-9ab0-4046-8283-25708b315144 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.020835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26436c3e-9ab0-4046-8283-25708b315144 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.020835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26436c3e-9ab0-4046-8283-25708b315144 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.022133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 666/1344] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:52:58.027529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c3702-ea13-47d3-8834-06badfaf255c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.028000 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c3702-ea13-47d3-8834-06badfaf255c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.028111 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c3702-ea13-47d3-8834-06badfaf255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.056802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-341c3702-ea13-47d3-8834-06badfaf255c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:58.058005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-341c3702-ea13-47d3-8834-06badfaf255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:58.145426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 679/1345] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:52:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:52:58.182069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26436c3e-9ab0-4046-8283-25708b315144 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:58.184045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-26436c3e-9ab0-4046-8283-25708b315144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:58.197913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26436c3e-9ab0-4046-8283-25708b315144 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:58.201528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27a05d-b02b-4a05-8cac-34b2afdd92a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:58.202249 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27a05d-b02b-4a05-8cac-34b2afdd92a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.202606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27a05d-b02b-4a05-8cac-34b2afdd92a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.202892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27a05d-b02b-4a05-8cac-34b2afdd92a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.213281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27a05d-b02b-4a05-8cac-34b2afdd92a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:58.214733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27a05d-b02b-4a05-8cac-34b2afdd92a5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:58.225559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 667/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:52:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:02.967193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9d7f6-e3ad-4751-b0b9-38a52313f21b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:02.967727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9d7f6-e3ad-4751-b0b9-38a52313f21b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:02.967841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9d7f6-e3ad-4751-b0b9-38a52313f21b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:02.969190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 680/1347] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:02.974942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3dac-26e4-4704-9401-d3a3042df112 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:02.975386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3dac-26e4-4704-9401-d3a3042df112 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:02.975577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3dac-26e4-4704-9401-d3a3042df112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:02.995701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42aa3dac-26e4-4704-9401-d3a3042df112 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:02.996973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42aa3dac-26e4-4704-9401-d3a3042df112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:03.012580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 668/1348] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:03.051907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9d7f6-e3ad-4751-b0b9-38a52313f21b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:03.063243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9d7f6-e3ad-4751-b0b9-38a52313f21b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:03.068487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218bc54-de23-46cc-8b25-eeef7bddcb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:03.069223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218bc54-de23-46cc-8b25-eeef7bddcb61 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:03.069579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218bc54-de23-46cc-8b25-eeef7bddcb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:03.069928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218bc54-de23-46cc-8b25-eeef7bddcb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:03.080057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218bc54-de23-46cc-8b25-eeef7bddcb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:03.081883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218bc54-de23-46cc-8b25-eeef7bddcb61 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:03.092314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 681/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:08.840151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe5b8-7791-4c22-a5de-1e91f48be933 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.840151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe5b8-7791-4c22-a5de-1e91f48be933 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.847960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe5b8-7791-4c22-a5de-1e91f48be933 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.847960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 669/1350] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 17:53:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:08.860898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f3d0e-ccf5-4f52-b046-953024bc106d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.862039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f3d0e-ccf5-4f52-b046-953024bc106d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.862039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f3d0e-ccf5-4f52-b046-953024bc106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.952129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-223f3d0e-ccf5-4f52-b046-953024bc106d None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:08.954917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-223f3d0e-ccf5-4f52-b046-953024bc106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:08.987044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:09.077127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 682/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 17:53:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:12.988661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=72 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.312867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa7764-70cb-4390-9fe8-58c8fc8f5c42 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.313548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa7764-70cb-4390-9fe8-58c8fc8f5c42 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.313548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa7764-70cb-4390-9fe8-58c8fc8f5c42 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.315610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 670/1352] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 17:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:14.323249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1079a-1006-49d0-8060-09d719578458 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.323840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1079a-1006-49d0-8060-09d719578458 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.323840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1079a-1006-49d0-8060-09d719578458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.346156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d4d1079a-1006-49d0-8060-09d719578458 None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:14.347464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d4d1079a-1006-49d0-8060-09d719578458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:14.356982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 683/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 17:53:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:15.682882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad91f-152d-4343-9e58-7b8392ff8616 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:15.683429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad91f-152d-4343-9e58-7b8392ff8616 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:15.683429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad91f-152d-4343-9e58-7b8392ff8616 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:15.684873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 671/1354] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 17:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:15.690227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8a04e-9c74-4689-a8ae-97d58be7e038 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:15.690665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8a04e-9c74-4689-a8ae-97d58be7e038 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:15.690784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8a04e-9c74-4689-a8ae-97d58be7e038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:15.709297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d2e8a04e-9c74-4689-a8ae-97d58be7e038 None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:15.710513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d2e8a04e-9c74-4689-a8ae-97d58be7e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:15.719467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 684/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 17:53:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:19.873107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997572-a727-4cde-a59a-a0cfb1953931 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:19.873689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997572-a727-4cde-a59a-a0cfb1953931 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:19.873689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78997572-a727-4cde-a59a-a0cfb1953931 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:19.876303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 672/1356] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:19.881765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c6c7b-3ce0-4167-b345-aae6fe573e0f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:19.882592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c6c7b-3ce0-4167-b345-aae6fe573e0f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:19.882876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c6c7b-3ce0-4167-b345-aae6fe573e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:19.902142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-693c6c7b-3ce0-4167-b345-aae6fe573e0f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:19.903583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-693c6c7b-3ce0-4167-b345-aae6fe573e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:19.912034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 685/1357] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:19.968417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70316f-a9c2-43ee-9991-157e8e1cfd61 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:19.969010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70316f-a9c2-43ee-9991-157e8e1cfd61 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:19.969460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70316f-a9c2-43ee-9991-157e8e1cfd61 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:19.971821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 673/1358] 10.222.0.69 () {54 vars in 961 bytes} [Thu May 26 17:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:19.979170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97d97-eac1-4d38-ba24-6a0c87fd0d86 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:19.979645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97d97-eac1-4d38-ba24-6a0c87fd0d86 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:19.980152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97d97-eac1-4d38-ba24-6a0c87fd0d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:20.054030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-55f97d97-eac1-4d38-ba24-6a0c87fd0d86 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:20.055277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-55f97d97-eac1-4d38-ba24-6a0c87fd0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:20.162424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 686/1359] 10.222.0.69 () {58 vars in 1058 bytes} [Thu May 26 17:53:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:53:20.163606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70316f-a9c2-43ee-9991-157e8e1cfd61 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:20.179909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70316f-a9c2-43ee-9991-157e8e1cfd61 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:20.186380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5e36-4910-4c63-bc88-e53a3d306892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:20.187536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5e36-4910-4c63-bc88-e53a3d306892 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:20.187922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5e36-4910-4c63-bc88-e53a3d306892 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:20.188333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5e36-4910-4c63-bc88-e53a3d306892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:20.198631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5e36-4910-4c63-bc88-e53a3d306892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:20.200458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5e36-4910-4c63-bc88-e53a3d306892 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:20.211409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 674/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:22.726491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f7037-746e-4221-9b07-41de4c0922fd None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:22.727120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f7037-746e-4221-9b07-41de4c0922fd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:22.727120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f7037-746e-4221-9b07-41de4c0922fd None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:22.728760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 687/1361] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:22.734056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f908078-a91f-45cd-8667-a1002a6888fa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:22.734543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f908078-a91f-45cd-8667-a1002a6888fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:22.734633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f908078-a91f-45cd-8667-a1002a6888fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:22.757892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2f908078-a91f-45cd-8667-a1002a6888fa None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:22.762044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2f908078-a91f-45cd-8667-a1002a6888fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:22.772534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 675/1362] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:22.817598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f7037-746e-4221-9b07-41de4c0922fd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:22.832624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f7037-746e-4221-9b07-41de4c0922fd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:22.838103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3fb4-b16c-4a43-bd32-8d4458a77047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:22.838753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3fb4-b16c-4a43-bd32-8d4458a77047 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:22.839041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3fb4-b16c-4a43-bd32-8d4458a77047 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:22.839322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3fb4-b16c-4a43-bd32-8d4458a77047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:22.849524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3fb4-b16c-4a43-bd32-8d4458a77047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:22.851212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3fb4-b16c-4a43-bd32-8d4458a77047 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:22.862687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 688/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:25.463348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1cf50-7d80-4a63-b634-b41d4e83a497 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:25.463919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1cf50-7d80-4a63-b634-b41d4e83a497 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:25.463919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1cf50-7d80-4a63-b634-b41d4e83a497 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:25.465671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 676/1364] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:25.477820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c2ba1-2ae5-4aef-a5a6-d646c7dd7410 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:25.478309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c2ba1-2ae5-4aef-a5a6-d646c7dd7410 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:25.481390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c2ba1-2ae5-4aef-a5a6-d646c7dd7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:25.510057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-091c2ba1-2ae5-4aef-a5a6-d646c7dd7410 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:25.511526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-091c2ba1-2ae5-4aef-a5a6-d646c7dd7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:25.546745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 689/1365] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:25.582955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359f94c-1eb9-4efe-b567-61413c8cc6b6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:25.583243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359f94c-1eb9-4efe-b567-61413c8cc6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:25.583729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359f94c-1eb9-4efe-b567-61413c8cc6b6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:25.585710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 677/1366] 10.222.0.69 () {54 vars in 961 bytes} [Thu May 26 17:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:25.592075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7dada-4c8c-426a-b26b-82f59bae82f7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:25.592532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7dada-4c8c-426a-b26b-82f59bae82f7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:25.592909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7dada-4c8c-426a-b26b-82f59bae82f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:25.614278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-08b7dada-4c8c-426a-b26b-82f59bae82f7 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:25.615925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-08b7dada-4c8c-426a-b26b-82f59bae82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:25.626846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 690/1367] 10.222.0.69 () {58 vars in 1058 bytes} [Thu May 26 17:53:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:25.635700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359f94c-1eb9-4efe-b567-61413c8cc6b6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:25.651767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359f94c-1eb9-4efe-b567-61413c8cc6b6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:25.658250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da004c-b24e-417b-95e9-7524f251662f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:25.659093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da004c-b24e-417b-95e9-7524f251662f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:25.659380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da004c-b24e-417b-95e9-7524f251662f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:25.659691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da004c-b24e-417b-95e9-7524f251662f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:25.669343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da004c-b24e-417b-95e9-7524f251662f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:25.670976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da004c-b24e-417b-95e9-7524f251662f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:25.682257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 678/1368] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:28.043154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c12d-68ab-44a3-93a5-a23fafab6fd8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.044006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c12d-68ab-44a3-93a5-a23fafab6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.044409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c12d-68ab-44a3-93a5-a23fafab6fd8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.045713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 691/1369] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:28.052121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828b2a-ef75-4ca4-a81c-c6e274274295 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.052600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828b2a-ef75-4ca4-a81c-c6e274274295 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.052679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828b2a-ef75-4ca4-a81c-c6e274274295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.071620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0f828b2a-ef75-4ca4-a81c-c6e274274295 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:28.072876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f828b2a-ef75-4ca4-a81c-c6e274274295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:28.080884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 679/1370] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:28.129544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c12d-68ab-44a3-93a5-a23fafab6fd8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:28.146732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c12d-68ab-44a3-93a5-a23fafab6fd8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:28.152771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4589be-b131-433e-9b64-78a3ed9b927f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:28.153574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4589be-b131-433e-9b64-78a3ed9b927f service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.153937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4589be-b131-433e-9b64-78a3ed9b927f service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.154292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4589be-b131-433e-9b64-78a3ed9b927f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.163960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4589be-b131-433e-9b64-78a3ed9b927f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:28.165955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4589be-b131-433e-9b64-78a3ed9b927f service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:28.178045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 692/1371] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:28.315835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5a334-673d-4f0b-9703-00b75966158b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.316252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5a334-673d-4f0b-9703-00b75966158b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.316371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5a334-673d-4f0b-9703-00b75966158b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.318116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 680/1372] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:28.323929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2ebf3-d9fb-41a5-97c2-21d34580117b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.324528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2ebf3-d9fb-41a5-97c2-21d34580117b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.324816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2ebf3-d9fb-41a5-97c2-21d34580117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.345786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2bb2ebf3-d9fb-41a5-97c2-21d34580117b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:28.347053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2bb2ebf3-d9fb-41a5-97c2-21d34580117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:28.356138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 693/1373] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:28.676149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534c97-108a-48a5-be2b-b6bae7ccc317 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.676149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534c97-108a-48a5-be2b-b6bae7ccc317 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.676149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534c97-108a-48a5-be2b-b6bae7ccc317 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.680088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 681/1374] 10.222.0.69 () {54 vars in 963 bytes} [Thu May 26 17:53:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:28.686634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6f9f-599b-4eb0-9a73-633c89cb4d32 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.686928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6f9f-599b-4eb0-9a73-633c89cb4d32 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.687208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6f9f-599b-4eb0-9a73-633c89cb4d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.695570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:28.747644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5e4e6f9f-599b-4eb0-9a73-633c89cb4d32 None None] MFA Rules not processed for user `0d8e2195d53743f78c58cebdcd850fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:28.748893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5e4e6f9f-599b-4eb0-9a73-633c89cb4d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:28.816602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 694/1375] 10.222.0.69 () {58 vars in 1060 bytes} [Thu May 26 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:28.824066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534c97-108a-48a5-be2b-b6bae7ccc317 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:28.835564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534c97-108a-48a5-be2b-b6bae7ccc317 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:28.839249 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786cc12-f628-48f7-bf39-c52cb5cfd5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:28.839982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cc12-f628-48f7-bf39-c52cb5cfd5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:28.840540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cc12-f628-48f7-bf39-c52cb5cfd5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:28.840896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cc12-f628-48f7-bf39-c52cb5cfd5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:28.851754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cc12-f628-48f7-bf39-c52cb5cfd5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:28.853325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cc12-f628-48f7-bf39-c52cb5cfd5c8 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:28.868160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 682/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:30.510921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af5c24-ddd1-4d70-8bdf-f6a009b00f78 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:30.511485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af5c24-ddd1-4d70-8bdf-f6a009b00f78 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:30.511647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af5c24-ddd1-4d70-8bdf-f6a009b00f78 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:30.513674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 695/1377] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:30.521227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f158f-6931-4bd7-bbfc-11e0d57cc83b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:30.521786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f158f-6931-4bd7-bbfc-11e0d57cc83b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:30.521786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f158f-6931-4bd7-bbfc-11e0d57cc83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:30.542589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3f0f158f-6931-4bd7-bbfc-11e0d57cc83b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:30.543927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f0f158f-6931-4bd7-bbfc-11e0d57cc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:30.553065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 683/1378] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:30.601868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af5c24-ddd1-4d70-8bdf-f6a009b00f78 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:30.617061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af5c24-ddd1-4d70-8bdf-f6a009b00f78 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:30.622730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912d5a3-2c70-4a50-a996-3314e8c83754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:30.623402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d5a3-2c70-4a50-a996-3314e8c83754 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:30.623688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d5a3-2c70-4a50-a996-3314e8c83754 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:30.623966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d5a3-2c70-4a50-a996-3314e8c83754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:30.634548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912d5a3-2c70-4a50-a996-3314e8c83754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:30.636208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912d5a3-2c70-4a50-a996-3314e8c83754 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:30.648097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 696/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:32.981834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019607-3cf2-47f6-8b3d-303b22136a48 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:32.982413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019607-3cf2-47f6-8b3d-303b22136a48 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:32.982413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019607-3cf2-47f6-8b3d-303b22136a48 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:32.983807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 684/1380] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:32.990506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a8f7-1ee3-49e0-a236-90592df15120 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:32.991598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a8f7-1ee3-49e0-a236-90592df15120 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:32.992148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a8f7-1ee3-49e0-a236-90592df15120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:33.012963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7c42a8f7-1ee3-49e0-a236-90592df15120 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:33.014349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7c42a8f7-1ee3-49e0-a236-90592df15120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:33.024058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 697/1381] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:33.069092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019607-3cf2-47f6-8b3d-303b22136a48 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:33.085486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019607-3cf2-47f6-8b3d-303b22136a48 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:33.091582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c4036-934b-47d4-84b1-42f32e78a225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:33.092423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c4036-934b-47d4-84b1-42f32e78a225 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:33.092811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c4036-934b-47d4-84b1-42f32e78a225 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:33.093191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c4036-934b-47d4-84b1-42f32e78a225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:33.103579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c4036-934b-47d4-84b1-42f32e78a225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:33.105397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c4036-934b-47d4-84b1-42f32e78a225 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:33.117083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 685/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:53:35.406334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f586-36f6-45e9-96bd-0eb40fdd6956 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:35.407190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f586-36f6-45e9-96bd-0eb40fdd6956 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:35.407190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f586-36f6-45e9-96bd-0eb40fdd6956 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:35.408266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 698/1383] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:35.413828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f308-22c4-43dc-b117-6ccb5ffb3c39 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:35.414348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f308-22c4-43dc-b117-6ccb5ffb3c39 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:35.414475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f308-22c4-43dc-b117-6ccb5ffb3c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:35.432904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2719f308-22c4-43dc-b117-6ccb5ffb3c39 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:35.434080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2719f308-22c4-43dc-b117-6ccb5ffb3c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:35.442728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 686/1384] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:35.486973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f586-36f6-45e9-96bd-0eb40fdd6956 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:35.505014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f586-36f6-45e9-96bd-0eb40fdd6956 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:35.511338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b22e-68fe-4ddc-ac9d-e2a7c3d0c0df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:35.512064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b22e-68fe-4ddc-ac9d-e2a7c3d0c0df service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:35.512354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b22e-68fe-4ddc-ac9d-e2a7c3d0c0df service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:35.512636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b22e-68fe-4ddc-ac9d-e2a7c3d0c0df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:35.522717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b22e-68fe-4ddc-ac9d-e2a7c3d0c0df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:35.524415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b22e-68fe-4ddc-ac9d-e2a7c3d0c0df service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:35.536269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 699/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:37.825192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3373a-5274-4e4c-9728-245ccfd375c1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:37.825756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3373a-5274-4e4c-9728-245ccfd375c1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:37.825756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3373a-5274-4e4c-9728-245ccfd375c1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:37.827149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 687/1386] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:37.833222 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4533b-60a3-484f-820e-381837e2e816 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:37.833787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4533b-60a3-484f-820e-381837e2e816 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:37.833787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4533b-60a3-484f-820e-381837e2e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:37.852777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a3f4533b-60a3-484f-820e-381837e2e816 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:37.854016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a3f4533b-60a3-484f-820e-381837e2e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:37.863140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 700/1387] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:37.909607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3373a-5274-4e4c-9728-245ccfd375c1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:37.926034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3373a-5274-4e4c-9728-245ccfd375c1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:37.931816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd47d-4e1e-48f9-a460-0d4bcb25dce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:37.932525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd47d-4e1e-48f9-a460-0d4bcb25dce2 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:37.932809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd47d-4e1e-48f9-a460-0d4bcb25dce2 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:37.933085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd47d-4e1e-48f9-a460-0d4bcb25dce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:37.943507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cd47d-4e1e-48f9-a460-0d4bcb25dce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:37.945208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cd47d-4e1e-48f9-a460-0d4bcb25dce2 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:37.955432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 688/1388] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:40.229179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa286a-0506-4e77-a0ef-8f67504e1333 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:40.229733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa286a-0506-4e77-a0ef-8f67504e1333 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:40.229733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa286a-0506-4e77-a0ef-8f67504e1333 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:40.231198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 701/1389] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:40.237884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4335d-e037-4356-b346-c17c1336d595 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:40.238602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4335d-e037-4356-b346-c17c1336d595 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:40.238602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4335d-e037-4356-b346-c17c1336d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:40.261963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bad4335d-e037-4356-b346-c17c1336d595 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:40.263597 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bad4335d-e037-4356-b346-c17c1336d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:40.274819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 689/1390] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:40.319915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa286a-0506-4e77-a0ef-8f67504e1333 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:40.335466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa286a-0506-4e77-a0ef-8f67504e1333 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:40.341505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2198-6b9e-4b29-94be-9908d0731b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:40.342187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2198-6b9e-4b29-94be-9908d0731b39 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:40.342466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2198-6b9e-4b29-94be-9908d0731b39 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:40.342743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2198-6b9e-4b29-94be-9908d0731b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:40.352682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2198-6b9e-4b29-94be-9908d0731b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:40.354282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2198-6b9e-4b29-94be-9908d0731b39 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:40.364775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 702/1391] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:42.632921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd902a5-2ed0-4224-9382-b3e414c92c90 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.633523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd902a5-2ed0-4224-9382-b3e414c92c90 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.633523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd902a5-2ed0-4224-9382-b3e414c92c90 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.634844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 690/1392] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:42.640107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd72e-30c0-4330-a9aa-2adaed65e283 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.640609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd72e-30c0-4330-a9aa-2adaed65e283 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.641527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd72e-30c0-4330-a9aa-2adaed65e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.660171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-327dd72e-30c0-4330-a9aa-2adaed65e283 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:42.661376 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-327dd72e-30c0-4330-a9aa-2adaed65e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:42.671236 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 703/1393] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:42.718061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd902a5-2ed0-4224-9382-b3e414c92c90 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:42.732520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd902a5-2ed0-4224-9382-b3e414c92c90 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:42.738426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bab10-a64c-4428-aa36-adba919e7745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:42.739071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bab10-a64c-4428-aa36-adba919e7745 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.739356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bab10-a64c-4428-aa36-adba919e7745 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.739634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bab10-a64c-4428-aa36-adba919e7745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.748209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bab10-a64c-4428-aa36-adba919e7745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:42.750318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bab10-a64c-4428-aa36-adba919e7745 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:42.761299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 691/1394] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:45.089101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d370370-f325-430c-9fd7-57e5d8656ef8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.089695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d370370-f325-430c-9fd7-57e5d8656ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.089695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d370370-f325-430c-9fd7-57e5d8656ef8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.091122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 704/1395] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:45.099253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18fb4-3eba-44f8-b53a-821cfeeb16f0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.099813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18fb4-3eba-44f8-b53a-821cfeeb16f0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.099813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18fb4-3eba-44f8-b53a-821cfeeb16f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.106061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=52 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:45.120735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-04b18fb4-3eba-44f8-b53a-821cfeeb16f0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:45.121951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04b18fb4-3eba-44f8-b53a-821cfeeb16f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:45.132740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 692/1396] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:45.140384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9161f5-2b7d-48e2-bc2d-f82160a99f0f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.142274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9161f5-2b7d-48e2-bc2d-f82160a99f0f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.142274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9161f5-2b7d-48e2-bc2d-f82160a99f0f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.143152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 705/1397] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:45.148661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaeba5-e507-4ab9-b56f-4c97712d0f11 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.149241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaeba5-e507-4ab9-b56f-4c97712d0f11 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.149533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaeba5-e507-4ab9-b56f-4c97712d0f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.171354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a8eaeba5-e507-4ab9-b56f-4c97712d0f11 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:45.173371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8eaeba5-e507-4ab9-b56f-4c97712d0f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:45.177400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9161f5-2b7d-48e2-bc2d-f82160a99f0f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:45.181860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 693/1398] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:45.194161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9161f5-2b7d-48e2-bc2d-f82160a99f0f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:45.204687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4223df-a34c-4a25-a4b2-75dec6c147cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:45.204687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4223df-a34c-4a25-a4b2-75dec6c147cf service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.204687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4223df-a34c-4a25-a4b2-75dec6c147cf service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.204687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4223df-a34c-4a25-a4b2-75dec6c147cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.212721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4223df-a34c-4a25-a4b2-75dec6c147cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:45.216803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4223df-a34c-4a25-a4b2-75dec6c147cf service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:45.225287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 706/1399] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:53:45.241102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964c03-e786-4953-bbdb-506b0174f757 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.241363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964c03-e786-4953-bbdb-506b0174f757 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.241657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964c03-e786-4953-bbdb-506b0174f757 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.243144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 694/1400] 10.222.0.69 () {54 vars in 962 bytes} [Thu May 26 17:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:45.248660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c9077-c46f-4508-9bb8-45903253b48f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.248956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c9077-c46f-4508-9bb8-45903253b48f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.249239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c9077-c46f-4508-9bb8-45903253b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.311126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6b4c9077-c46f-4508-9bb8-45903253b48f None None] MFA Rules not processed for user `44ef983c46894dc6bff7fff34cc4e50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:45.313121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6b4c9077-c46f-4508-9bb8-45903253b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:45.372092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:45.398181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 707/1401] 10.222.0.69 () {58 vars in 1059 bytes} [Thu May 26 17:53:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:45.406448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a964c03-e786-4953-bbdb-506b0174f757 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:45.418731 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a964c03-e786-4953-bbdb-506b0174f757 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:45.423729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a51f6-4bd8-4b4e-b847-b80b89b79964 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:45.424528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a51f6-4bd8-4b4e-b847-b80b89b79964 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.424844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a51f6-4bd8-4b4e-b847-b80b89b79964 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.425121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a51f6-4bd8-4b4e-b847-b80b89b79964 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.435358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a51f6-4bd8-4b4e-b847-b80b89b79964 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:45.436833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a51f6-4bd8-4b4e-b847-b80b89b79964 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:45.449893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 695/1402] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:46.019886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eab50-8db6-4add-8ccd-08fb2aa6281b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:46.020227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eab50-8db6-4add-8ccd-08fb2aa6281b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:46.020536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eab50-8db6-4add-8ccd-08fb2aa6281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:46.075150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3d4eab50-8db6-4add-8ccd-08fb2aa6281b None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:46.076427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d4eab50-8db6-4add-8ccd-08fb2aa6281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:46.149707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 708/1403] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 17:53:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:53:46.193144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969bc2-618a-4e6c-bc2c-8fce7ba68e15 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:46.193702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969bc2-618a-4e6c-bc2c-8fce7ba68e15 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:46.193702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969bc2-618a-4e6c-bc2c-8fce7ba68e15 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:46.195087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 696/1404] 10.222.0.69 () {54 vars in 942 bytes} [Thu May 26 17:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:46.204825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ebf8-bef1-4899-92c6-67ab04ae0713 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:46.205437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ebf8-bef1-4899-92c6-67ab04ae0713 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:46.205911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ebf8-bef1-4899-92c6-67ab04ae0713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:46.258559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0019ebf8-bef1-4899-92c6-67ab04ae0713 None None] MFA Rules not processed for user `0dc7da9d33b941dc91a98c8adbb545d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:46.259709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0019ebf8-bef1-4899-92c6-67ab04ae0713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:46.336435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 709/1405] 10.222.0.69 () {58 vars in 1039 bytes} [Thu May 26 17:53:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:53:46.346157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969bc2-618a-4e6c-bc2c-8fce7ba68e15 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:46.360189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969bc2-618a-4e6c-bc2c-8fce7ba68e15 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:46.365137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529260-5f36-4086-b29c-74069784b99d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:46.365789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529260-5f36-4086-b29c-74069784b99d service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:46.366081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529260-5f36-4086-b29c-74069784b99d service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:46.366365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529260-5f36-4086-b29c-74069784b99d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:46.375882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529260-5f36-4086-b29c-74069784b99d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:46.377794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529260-5f36-4086-b29c-74069784b99d service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:46.387206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 697/1406] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 17:53:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:53:47.574252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaba8a-6c34-42c9-9898-cfc9322dbb64 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:47.574827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaba8a-6c34-42c9-9898-cfc9322dbb64 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:47.574827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaba8a-6c34-42c9-9898-cfc9322dbb64 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:47.581768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be851-cc6e-4a85-9013-7a7a5a528465 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:47.582638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be851-cc6e-4a85-9013-7a7a5a528465 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:47.583107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be851-cc6e-4a85-9013-7a7a5a528465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:47.585271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 710/1407] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:53:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:53:47.602905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f45be851-cc6e-4a85-9013-7a7a5a528465 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:47.604582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f45be851-cc6e-4a85-9013-7a7a5a528465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:47.614635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 698/1408] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:53:47.663567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaba8a-6c34-42c9-9898-cfc9322dbb64 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:47.685236 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaba8a-6c34-42c9-9898-cfc9322dbb64 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:47.693518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836ce9-a009-463d-a223-bc39fe0ed743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:47.694195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836ce9-a009-463d-a223-bc39fe0ed743 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:47.694476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836ce9-a009-463d-a223-bc39fe0ed743 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:47.694755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836ce9-a009-463d-a223-bc39fe0ed743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:47.705443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31836ce9-a009-463d-a223-bc39fe0ed743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:47.707062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31836ce9-a009-463d-a223-bc39fe0ed743 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:47.717899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 711/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:53:57.596998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=20 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:57.713166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:10.980449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e085dd-0a56-4c44-aa1d-2aecffcfa3b9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:10.981419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e085dd-0a56-4c44-aa1d-2aecffcfa3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:10.981419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e085dd-0a56-4c44-aa1d-2aecffcfa3b9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:10.984144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 699/1410] 10.222.0.69 () {54 vars in 918 bytes} [Thu May 26 17:54:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:10.991654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064d7d5-3a77-4bf0-9a3d-21c2d3a5c3bf None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:10.992327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064d7d5-3a77-4bf0-9a3d-21c2d3a5c3bf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:10.992435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064d7d5-3a77-4bf0-9a3d-21c2d3a5c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:11.021590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2064d7d5-3a77-4bf0-9a3d-21c2d3a5c3bf None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:11.023502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2064d7d5-3a77-4bf0-9a3d-21c2d3a5c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:11.035607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 712/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Thu May 26 17:54:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:54:11.060102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48fe67-d3ba-4f39-a49c-50d06a6f6cdd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:11.060540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48fe67-d3ba-4f39-a49c-50d06a6f6cdd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:11.061340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48fe67-d3ba-4f39-a49c-50d06a6f6cdd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:11.062972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 700/1412] 10.222.0.69 () {54 vars in 918 bytes} [Thu May 26 17:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:11.068951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf897-a2e5-43f3-96ad-00721ff64c4d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:11.069244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf897-a2e5-43f3-96ad-00721ff64c4d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:11.069528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf897-a2e5-43f3-96ad-00721ff64c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:11.097909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a00bf897-a2e5-43f3-96ad-00721ff64c4d None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:11.099178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a00bf897-a2e5-43f3-96ad-00721ff64c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:11.109879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 713/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Thu May 26 17:54:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:14.259355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6115-909e-4072-98cd-f6fe0ee3e6f8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:14.260009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6115-909e-4072-98cd-f6fe0ee3e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:14.260009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6115-909e-4072-98cd-f6fe0ee3e6f8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:14.261674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:14.268635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf1e15-ebab-49ea-bf70-a445e1190d23 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:14.269193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf1e15-ebab-49ea-bf70-a445e1190d23 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:14.269193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf1e15-ebab-49ea-bf70-a445e1190d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:14.289505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-23bf1e15-ebab-49ea-bf70-a445e1190d23 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:14.290917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-23bf1e15-ebab-49ea-bf70-a445e1190d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:14.301744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:14.368150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d6115-909e-4072-98cd-f6fe0ee3e6f8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:14.385568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d6115-909e-4072-98cd-f6fe0ee3e6f8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:14.393970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ddf59-b141-4fd5-af59-f33fa5200106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:14.394892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ddf59-b141-4fd5-af59-f33fa5200106 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:14.395322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ddf59-b141-4fd5-af59-f33fa5200106 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:14.395780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ddf59-b141-4fd5-af59-f33fa5200106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:14.405682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ddf59-b141-4fd5-af59-f33fa5200106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:14.407270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ddf59-b141-4fd5-af59-f33fa5200106 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:14.417455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 702/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:15.511779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516dfb4-481a-4baf-9c6e-fbf0d2537774 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:15.512402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516dfb4-481a-4baf-9c6e-fbf0d2537774 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:15.512402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516dfb4-481a-4baf-9c6e-fbf0d2537774 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:15.513797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:54:15.519730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497ca46-b30e-477a-bba3-f671431133ee None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:15.520282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497ca46-b30e-477a-bba3-f671431133ee None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:15.520374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497ca46-b30e-477a-bba3-f671431133ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:15.542387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4497ca46-b30e-477a-bba3-f671431133ee None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:15.543616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4497ca46-b30e-477a-bba3-f671431133ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:15.552401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:15.749532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516dfb4-481a-4baf-9c6e-fbf0d2537774 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:15.768434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516dfb4-481a-4baf-9c6e-fbf0d2537774 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:15.774284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3760d-b651-46b2-9a38-1b5caf20e76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:15.774943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3760d-b651-46b2-9a38-1b5caf20e76b service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:15.775230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3760d-b651-46b2-9a38-1b5caf20e76b service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:15.775514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3760d-b651-46b2-9a38-1b5caf20e76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:15.785940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3760d-b651-46b2-9a38-1b5caf20e76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:15.787548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3760d-b651-46b2-9a38-1b5caf20e76b service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:15.799378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 716/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:16.822685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b5ed-65d7-45a1-80d7-27101c787be9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:16.823299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b5ed-65d7-45a1-80d7-27101c787be9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:16.823488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b5ed-65d7-45a1-80d7-27101c787be9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:16.825146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:16.832560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f43c1-45da-4bf5-9580-2be08810c750 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:16.833104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f43c1-45da-4bf5-9580-2be08810c750 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:16.833199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f43c1-45da-4bf5-9580-2be08810c750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:16.856189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fb5f43c1-45da-4bf5-9580-2be08810c750 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:16.857662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb5f43c1-45da-4bf5-9580-2be08810c750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:16.867010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:17.025591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185b5ed-65d7-45a1-80d7-27101c787be9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:17.040969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185b5ed-65d7-45a1-80d7-27101c787be9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:17.046988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714532c0-026b-4cfc-af99-f623248e219d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:17.047643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714532c0-026b-4cfc-af99-f623248e219d service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:17.047947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714532c0-026b-4cfc-af99-f623248e219d service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:17.048257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714532c0-026b-4cfc-af99-f623248e219d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:17.057736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714532c0-026b-4cfc-af99-f623248e219d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:17.059395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714532c0-026b-4cfc-af99-f623248e219d service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:17.070674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 705/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:18.086508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6ae13-8884-41f7-98dd-247c1db59c25 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:18.087067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6ae13-8884-41f7-98dd-247c1db59c25 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:18.087067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6ae13-8884-41f7-98dd-247c1db59c25 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:18.088385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:18.094647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba5990-c55b-4453-8a9d-f81ebc310dc3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:18.095146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba5990-c55b-4453-8a9d-f81ebc310dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:18.095238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba5990-c55b-4453-8a9d-f81ebc310dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:18.113801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-aaba5990-c55b-4453-8a9d-f81ebc310dc3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:18.114998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aaba5990-c55b-4453-8a9d-f81ebc310dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:18.123144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:18.287992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6ae13-8884-41f7-98dd-247c1db59c25 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:18.304945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6ae13-8884-41f7-98dd-247c1db59c25 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:18.311423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8126a-72d1-4432-abf3-12d0a45e27fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:18.312227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8126a-72d1-4432-abf3-12d0a45e27fe service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:18.312545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8126a-72d1-4432-abf3-12d0a45e27fe service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:18.312971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8126a-72d1-4432-abf3-12d0a45e27fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:18.322739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8126a-72d1-4432-abf3-12d0a45e27fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:18.324532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8126a-72d1-4432-abf3-12d0a45e27fe service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:18.336953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 719/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:19.308985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234a87-5f7d-436f-9dfa-457a081d2f6c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:19.309639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234a87-5f7d-436f-9dfa-457a081d2f6c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:19.309639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234a87-5f7d-436f-9dfa-457a081d2f6c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:19.311196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:19.316827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027c17-3620-477f-98fe-fffc86192372 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:19.317456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027c17-3620-477f-98fe-fffc86192372 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:19.317579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027c17-3620-477f-98fe-fffc86192372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:19.338248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-69027c17-3620-477f-98fe-fffc86192372 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:19.339474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69027c17-3620-477f-98fe-fffc86192372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:19.348925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:19.510639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234a87-5f7d-436f-9dfa-457a081d2f6c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:19.526628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234a87-5f7d-436f-9dfa-457a081d2f6c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:19.532759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e119-124f-4ab2-b733-fe5f71b2373c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:19.533408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e119-124f-4ab2-b733-fe5f71b2373c service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:19.533704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e119-124f-4ab2-b733-fe5f71b2373c service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:19.533985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e119-124f-4ab2-b733-fe5f71b2373c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:19.543415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e119-124f-4ab2-b733-fe5f71b2373c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:19.545618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e119-124f-4ab2-b733-fe5f71b2373c service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:19.557668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 708/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:20.449897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bd69d-d62b-4a3a-8f18-c4d18a947dc1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:20.450494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bd69d-d62b-4a3a-8f18-c4d18a947dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:20.450494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bd69d-d62b-4a3a-8f18-c4d18a947dc1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:20.452664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:20.464709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fdf3-5558-43d7-9612-a669c2e25e94 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:20.465258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fdf3-5558-43d7-9612-a669c2e25e94 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:20.465258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fdf3-5558-43d7-9612-a669c2e25e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:20.484880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8c59fdf3-5558-43d7-9612-a669c2e25e94 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:20.486062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8c59fdf3-5558-43d7-9612-a669c2e25e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:20.494347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:20.647379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bd69d-d62b-4a3a-8f18-c4d18a947dc1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:20.663050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bd69d-d62b-4a3a-8f18-c4d18a947dc1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:20.669219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc4a9b-0706-4f99-89bd-6868eb806eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:20.670984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc4a9b-0706-4f99-89bd-6868eb806eba service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:20.670984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc4a9b-0706-4f99-89bd-6868eb806eba service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:20.671259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc4a9b-0706-4f99-89bd-6868eb806eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:20.681341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc4a9b-0706-4f99-89bd-6868eb806eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:20.683024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc4a9b-0706-4f99-89bd-6868eb806eba service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:20.696509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 722/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:54:21.581998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a7e6-302c-44b1-98be-c79b16b3b6d3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:21.582823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a7e6-302c-44b1-98be-c79b16b3b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:21.583013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a7e6-302c-44b1-98be-c79b16b3b6d3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:21.584735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:21.590271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4517d-591b-4847-9859-8010033026c6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:21.591287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4517d-591b-4847-9859-8010033026c6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:21.591287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4517d-591b-4847-9859-8010033026c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:21.611728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-27e4517d-591b-4847-9859-8010033026c6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:21.613031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-27e4517d-591b-4847-9859-8010033026c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:21.622444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:54:21.793213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954a7e6-302c-44b1-98be-c79b16b3b6d3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:21.809738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954a7e6-302c-44b1-98be-c79b16b3b6d3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:21.817642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab6ff-4d1d-47be-8820-a1704f814761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:21.818472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab6ff-4d1d-47be-8820-a1704f814761 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:21.818792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab6ff-4d1d-47be-8820-a1704f814761 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:21.819195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab6ff-4d1d-47be-8820-a1704f814761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:21.830608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab6ff-4d1d-47be-8820-a1704f814761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:21.832538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab6ff-4d1d-47be-8820-a1704f814761 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:21.846797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 711/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:54:22.804605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70186f7-fddd-4e1a-bff5-459d8045733e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:22.805185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70186f7-fddd-4e1a-bff5-459d8045733e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:22.805185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70186f7-fddd-4e1a-bff5-459d8045733e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:22.806605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:22.812997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143961fa-b4b3-41b2-bc96-f763716b5767 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:22.813553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143961fa-b4b3-41b2-bc96-f763716b5767 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:22.813650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143961fa-b4b3-41b2-bc96-f763716b5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:22.836582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-143961fa-b4b3-41b2-bc96-f763716b5767 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:22.837965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-143961fa-b4b3-41b2-bc96-f763716b5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:22.848497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:23.017309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70186f7-fddd-4e1a-bff5-459d8045733e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:23.032566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70186f7-fddd-4e1a-bff5-459d8045733e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:23.038491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1e976-f21d-4725-9808-38d2f66e19d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:23.039152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e976-f21d-4725-9808-38d2f66e19d3 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:23.039440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e976-f21d-4725-9808-38d2f66e19d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:23.039724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e976-f21d-4725-9808-38d2f66e19d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:23.049599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e976-f21d-4725-9808-38d2f66e19d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:23.051252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e976-f21d-4725-9808-38d2f66e19d3 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:23.063082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 725/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:23.972314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69555e-7a11-4fcf-a241-f6e5537b3740 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:23.972895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69555e-7a11-4fcf-a241-f6e5537b3740 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:23.972895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69555e-7a11-4fcf-a241-f6e5537b3740 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:23.974257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:23.979964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0e1b-e990-46dd-848b-3d8db8d17206 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:23.980522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0e1b-e990-46dd-848b-3d8db8d17206 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:23.980660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0e1b-e990-46dd-848b-3d8db8d17206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:24.001499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e03f0e1b-e990-46dd-848b-3d8db8d17206 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:24.002734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e03f0e1b-e990-46dd-848b-3d8db8d17206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:24.012701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:24.187168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69555e-7a11-4fcf-a241-f6e5537b3740 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:24.202931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69555e-7a11-4fcf-a241-f6e5537b3740 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:24.208828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61def-faa4-47b0-b17f-1eb7d00a9f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:24.209510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61def-faa4-47b0-b17f-1eb7d00a9f22 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:24.209800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61def-faa4-47b0-b17f-1eb7d00a9f22 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:24.210082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61def-faa4-47b0-b17f-1eb7d00a9f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:24.220006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61def-faa4-47b0-b17f-1eb7d00a9f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:24.221651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61def-faa4-47b0-b17f-1eb7d00a9f22 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:24.231755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 714/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:26.559206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb96b8-7c85-4ffb-9aa4-99e129c5803e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:26.559933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb96b8-7c85-4ffb-9aa4-99e129c5803e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:26.559933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb96b8-7c85-4ffb-9aa4-99e129c5803e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:26.561502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:26.568375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c2b8d-099c-4655-b392-c49512926ab3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:26.568972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c2b8d-099c-4655-b392-c49512926ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:26.568972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c2b8d-099c-4655-b392-c49512926ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:26.588827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-771c2b8d-099c-4655-b392-c49512926ab3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:26.590138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-771c2b8d-099c-4655-b392-c49512926ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:26.599536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:26.641805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb96b8-7c85-4ffb-9aa4-99e129c5803e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:26.653023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb96b8-7c85-4ffb-9aa4-99e129c5803e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:26.657473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2ef0f-663b-4b95-9846-30bf83ca9301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:26.658131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2ef0f-663b-4b95-9846-30bf83ca9301 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:26.658415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2ef0f-663b-4b95-9846-30bf83ca9301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:26.658693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2ef0f-663b-4b95-9846-30bf83ca9301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:26.669002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2ef0f-663b-4b95-9846-30bf83ca9301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:26.670627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2ef0f-663b-4b95-9846-30bf83ca9301 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:26.681158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 728/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:29.254455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fadf5c-8240-45ed-a33a-81d3c10b54a2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:29.255123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fadf5c-8240-45ed-a33a-81d3c10b54a2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:29.255123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fadf5c-8240-45ed-a33a-81d3c10b54a2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:29.256484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:29.261888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a88c2-7084-487a-b81b-976310ef11da None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:29.262306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a88c2-7084-487a-b81b-976310ef11da None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:29.262450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a88c2-7084-487a-b81b-976310ef11da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:29.280796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-df1a88c2-7084-487a-b81b-976310ef11da None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:29.282014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-df1a88c2-7084-487a-b81b-976310ef11da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:29.289850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:29.328742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fadf5c-8240-45ed-a33a-81d3c10b54a2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:29.339298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fadf5c-8240-45ed-a33a-81d3c10b54a2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:29.343324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1a5b9-c5f1-4479-bc38-de3ff6b08212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:29.343958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a5b9-c5f1-4479-bc38-de3ff6b08212 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:29.344270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a5b9-c5f1-4479-bc38-de3ff6b08212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:29.344543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a5b9-c5f1-4479-bc38-de3ff6b08212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:29.353350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1a5b9-c5f1-4479-bc38-de3ff6b08212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:29.354777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1a5b9-c5f1-4479-bc38-de3ff6b08212 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:29.364886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 717/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:31.947117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996629-dc13-4e9b-971d-4f055f4eb2c0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:31.947662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996629-dc13-4e9b-971d-4f055f4eb2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:31.947662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996629-dc13-4e9b-971d-4f055f4eb2c0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:31.949100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:31.955006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767162a-cdf2-469e-ba41-085fd99548cd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:31.955484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767162a-cdf2-469e-ba41-085fd99548cd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:31.955598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767162a-cdf2-469e-ba41-085fd99548cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:31.973881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8767162a-cdf2-469e-ba41-085fd99548cd None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:31.975139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8767162a-cdf2-469e-ba41-085fd99548cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:31.984463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:32.023904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996629-dc13-4e9b-971d-4f055f4eb2c0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:32.036090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996629-dc13-4e9b-971d-4f055f4eb2c0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:32.039781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a93882-2cb4-4817-9cc3-092e7b54371e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:32.040494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a93882-2cb4-4817-9cc3-092e7b54371e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:32.040785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a93882-2cb4-4817-9cc3-092e7b54371e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:32.041090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a93882-2cb4-4817-9cc3-092e7b54371e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:32.052238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a93882-2cb4-4817-9cc3-092e7b54371e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:32.053823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a93882-2cb4-4817-9cc3-092e7b54371e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:32.064683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 731/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:34.431894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267156dd-6981-47a5-b3ef-5c689c10c917 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:34.432519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267156dd-6981-47a5-b3ef-5c689c10c917 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:34.432519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267156dd-6981-47a5-b3ef-5c689c10c917 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:34.433890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:34.439586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bcfde-64fb-40a0-88ce-9e5daa954799 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:34.440202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bcfde-64fb-40a0-88ce-9e5daa954799 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:34.440202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bcfde-64fb-40a0-88ce-9e5daa954799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:34.458396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a37bcfde-64fb-40a0-88ce-9e5daa954799 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:34.459601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a37bcfde-64fb-40a0-88ce-9e5daa954799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:34.468542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:34.507116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267156dd-6981-47a5-b3ef-5c689c10c917 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:34.519088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267156dd-6981-47a5-b3ef-5c689c10c917 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:34.522664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98e51-06f1-4733-b834-bb58b7172f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:34.523302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98e51-06f1-4733-b834-bb58b7172f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:34.523592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98e51-06f1-4733-b834-bb58b7172f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:34.523876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98e51-06f1-4733-b834-bb58b7172f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:34.533912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb98e51-06f1-4733-b834-bb58b7172f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:34.535370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb98e51-06f1-4733-b834-bb58b7172f9d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:34.545957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 720/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:36.891714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd55f6-f33e-4f1a-b298-08b6594e2909 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:36.892320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd55f6-f33e-4f1a-b298-08b6594e2909 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:36.892320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd55f6-f33e-4f1a-b298-08b6594e2909 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:36.893710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:36.899235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc4dc-2545-4755-9fec-14a31c38f258 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:36.899658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc4dc-2545-4755-9fec-14a31c38f258 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:36.899775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc4dc-2545-4755-9fec-14a31c38f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:36.917963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-11dcc4dc-2545-4755-9fec-14a31c38f258 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:36.920230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-11dcc4dc-2545-4755-9fec-14a31c38f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:36.928062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:36.966639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd55f6-f33e-4f1a-b298-08b6594e2909 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:36.977643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd55f6-f33e-4f1a-b298-08b6594e2909 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:36.981747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bd48b-1e12-4d84-91f4-42a0e753fdea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:36.982492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd48b-1e12-4d84-91f4-42a0e753fdea service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:36.982780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd48b-1e12-4d84-91f4-42a0e753fdea service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:36.983061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd48b-1e12-4d84-91f4-42a0e753fdea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:36.992096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bd48b-1e12-4d84-91f4-42a0e753fdea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:36.993531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bd48b-1e12-4d84-91f4-42a0e753fdea service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:37.004328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 734/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:39.286804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b009d5-cf80-4ae8-aae8-05542adcb930 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:39.287380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b009d5-cf80-4ae8-aae8-05542adcb930 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:39.287380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b009d5-cf80-4ae8-aae8-05542adcb930 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:39.288807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:39.295341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53a99-1450-45b5-9685-e96b8d221d69 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:39.295920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53a99-1450-45b5-9685-e96b8d221d69 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:39.295920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53a99-1450-45b5-9685-e96b8d221d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:39.302411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=70 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:39.317269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a0d53a99-1450-45b5-9685-e96b8d221d69 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:39.318515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a0d53a99-1450-45b5-9685-e96b8d221d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:39.327355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:39.367914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b009d5-cf80-4ae8-aae8-05542adcb930 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:39.373895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=64 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:39.380630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b009d5-cf80-4ae8-aae8-05542adcb930 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:39.384260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0246145-e3d7-428d-8d63-4484dd204f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:39.384920 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0246145-e3d7-428d-8d63-4484dd204f8f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:39.385204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0246145-e3d7-428d-8d63-4484dd204f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:39.385478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0246145-e3d7-428d-8d63-4484dd204f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:39.395803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0246145-e3d7-428d-8d63-4484dd204f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:39.397293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0246145-e3d7-428d-8d63-4484dd204f8f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:39.408351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 723/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:41.703937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48575e-b7bc-411c-9102-03800230d20b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:41.704505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48575e-b7bc-411c-9102-03800230d20b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:41.704636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48575e-b7bc-411c-9102-03800230d20b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:41.705948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:41.711565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f721f-f19b-4423-a06d-1aca7c11fb2b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:41.712062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f721f-f19b-4423-a06d-1aca7c11fb2b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:41.712162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f721f-f19b-4423-a06d-1aca7c11fb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:41.729695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bd0f721f-f19b-4423-a06d-1aca7c11fb2b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:41.730937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd0f721f-f19b-4423-a06d-1aca7c11fb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:41.738860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:41.778717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48575e-b7bc-411c-9102-03800230d20b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:41.791901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48575e-b7bc-411c-9102-03800230d20b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:41.798292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0106c1-3a62-4fef-8a3e-0dbb975a5313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:41.799101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0106c1-3a62-4fef-8a3e-0dbb975a5313 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:41.799441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0106c1-3a62-4fef-8a3e-0dbb975a5313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:41.799805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0106c1-3a62-4fef-8a3e-0dbb975a5313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:41.813558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0106c1-3a62-4fef-8a3e-0dbb975a5313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:41.817032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0106c1-3a62-4fef-8a3e-0dbb975a5313 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:41.836563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 737/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:44.124389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac230-c30f-425e-8980-e27d8182ddd6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:44.124907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac230-c30f-425e-8980-e27d8182ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:44.124907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac230-c30f-425e-8980-e27d8182ddd6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:44.126246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:44.132002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf8d5-b258-4e55-ac4e-683b61f076ae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:44.132474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf8d5-b258-4e55-ac4e-683b61f076ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:44.132611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf8d5-b258-4e55-ac4e-683b61f076ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:44.151105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5a9cf8d5-b258-4e55-ac4e-683b61f076ae None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:44.152348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5a9cf8d5-b258-4e55-ac4e-683b61f076ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:44.161370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:44.202286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eac230-c30f-425e-8980-e27d8182ddd6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:44.213129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eac230-c30f-425e-8980-e27d8182ddd6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:44.217322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e62ca2-d369-4dd7-be05-307d387cdd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:44.217965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e62ca2-d369-4dd7-be05-307d387cdd57 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:44.218250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e62ca2-d369-4dd7-be05-307d387cdd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:44.218530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e62ca2-d369-4dd7-be05-307d387cdd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:44.227796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e62ca2-d369-4dd7-be05-307d387cdd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:44.229274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e62ca2-d369-4dd7-be05-307d387cdd57 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:44.239650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 726/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:46.503089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155dbc-d8e9-43be-8ccf-dddc70f21363 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:46.503696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155dbc-d8e9-43be-8ccf-dddc70f21363 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:46.503696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155dbc-d8e9-43be-8ccf-dddc70f21363 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:46.505318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:46.510702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a554b-2270-48c2-ac97-016cb7d1008d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:46.511157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a554b-2270-48c2-ac97-016cb7d1008d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:46.511265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a554b-2270-48c2-ac97-016cb7d1008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:46.529707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-536a554b-2270-48c2-ac97-016cb7d1008d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:46.530924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-536a554b-2270-48c2-ac97-016cb7d1008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:46.538845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:46.576504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155dbc-d8e9-43be-8ccf-dddc70f21363 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:46.587254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155dbc-d8e9-43be-8ccf-dddc70f21363 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:46.591762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2687d3-2b9f-4831-8035-1fce93f11c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:46.592443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2687d3-2b9f-4831-8035-1fce93f11c62 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:46.592731 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2687d3-2b9f-4831-8035-1fce93f11c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:46.593011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2687d3-2b9f-4831-8035-1fce93f11c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:46.602306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2687d3-2b9f-4831-8035-1fce93f11c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:46.603717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2687d3-2b9f-4831-8035-1fce93f11c62 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:46.613727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 740/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:48.885008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f930-30ab-4b40-bdb2-f61e22008149 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:48.885591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f930-30ab-4b40-bdb2-f61e22008149 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:48.885815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f930-30ab-4b40-bdb2-f61e22008149 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:48.887594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:54:48.893949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cabcf-ec46-4f77-bdf7-6a655e6141d9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:48.894440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cabcf-ec46-4f77-bdf7-6a655e6141d9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:48.894542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cabcf-ec46-4f77-bdf7-6a655e6141d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:48.912935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6e5cabcf-ec46-4f77-bdf7-6a655e6141d9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:48.914152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6e5cabcf-ec46-4f77-bdf7-6a655e6141d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:48.922939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:54:48.959985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f930-30ab-4b40-bdb2-f61e22008149 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:48.971312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f930-30ab-4b40-bdb2-f61e22008149 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:48.974930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4c076-5d00-446b-967b-30c3635f6040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:48.975576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c076-5d00-446b-967b-30c3635f6040 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:48.975872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c076-5d00-446b-967b-30c3635f6040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:48.976185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c076-5d00-446b-967b-30c3635f6040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:48.986401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4c076-5d00-446b-967b-30c3635f6040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:48.987890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4c076-5d00-446b-967b-30c3635f6040 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:48.998281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 729/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:54:58.907504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=20 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:58.993342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=23 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:23.482535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a49c-61fa-4613-8cec-ab6d6ed594ac None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:23.483153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a49c-61fa-4613-8cec-ab6d6ed594ac None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:23.483153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a49c-61fa-4613-8cec-ab6d6ed594ac None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:23.484522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 742/1471] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:23.490113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaebedb-28e5-408e-b058-cbdbcf263617 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:23.490623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaebedb-28e5-408e-b058-cbdbcf263617 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:23.490734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaebedb-28e5-408e-b058-cbdbcf263617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:23.510294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-edaebedb-28e5-408e-b058-cbdbcf263617 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:23.511607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-edaebedb-28e5-408e-b058-cbdbcf263617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:23.519624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 730/1472] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:55:23.568770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84450-2685-4773-b1f6-ff79e684ca74 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:23.569063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84450-2685-4773-b1f6-ff79e684ca74 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:23.569353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84450-2685-4773-b1f6-ff79e684ca74 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:23.570750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 743/1473] 10.222.0.69 () {54 vars in 962 bytes} [Thu May 26 17:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:23.575640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce944e-0956-4824-8faa-e83eca2ec42d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:23.575931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce944e-0956-4824-8faa-e83eca2ec42d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:23.576240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce944e-0956-4824-8faa-e83eca2ec42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:23.594863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b9ce944e-0956-4824-8faa-e83eca2ec42d None None] MFA Rules not processed for user `44ef983c46894dc6bff7fff34cc4e50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:23.596681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b9ce944e-0956-4824-8faa-e83eca2ec42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:23.604565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 731/1474] 10.222.0.69 () {58 vars in 1059 bytes} [Thu May 26 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:55:23.612083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e84450-2685-4773-b1f6-ff79e684ca74 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:23.623976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e84450-2685-4773-b1f6-ff79e684ca74 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:23.627780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578067-2359-4bf8-9cbc-9696342880a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:23.628471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578067-2359-4bf8-9cbc-9696342880a0 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:23.628766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578067-2359-4bf8-9cbc-9696342880a0 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:23.629046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578067-2359-4bf8-9cbc-9696342880a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:23.638826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578067-2359-4bf8-9cbc-9696342880a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:23.640318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578067-2359-4bf8-9cbc-9696342880a0 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:23.650358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 744/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:55:26.039825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c11111-255c-4c6c-a40b-0612d7e583d7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:26.040417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c11111-255c-4c6c-a40b-0612d7e583d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:26.040417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c11111-255c-4c6c-a40b-0612d7e583d7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:26.043636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 732/1476] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:55:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:26.049793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2096-3c0f-4843-8b62-04a4759b1952 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:26.050337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2096-3c0f-4843-8b62-04a4759b1952 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:26.050337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2096-3c0f-4843-8b62-04a4759b1952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:26.069913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-738c2096-3c0f-4843-8b62-04a4759b1952 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:26.071118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-738c2096-3c0f-4843-8b62-04a4759b1952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:26.083400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 745/1477] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:55:26.107688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c11111-255c-4c6c-a40b-0612d7e583d7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:26.125871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c11111-255c-4c6c-a40b-0612d7e583d7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:26.130416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d5f2-cef3-44f2-ba4d-601175f02338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:26.131251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d5f2-cef3-44f2-ba4d-601175f02338 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:26.131540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d5f2-cef3-44f2-ba4d-601175f02338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:26.131821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d5f2-cef3-44f2-ba4d-601175f02338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:26.132602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2d5f2-cef3-44f2-ba4d-601175f02338 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:26.135123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-adb2d5f2-cef3-44f2-ba4d-601175f02338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:55:26.135123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 17:55:26.135123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 17:55:26.136364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2d5f2-cef3-44f2-ba4d-601175f02338 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:26.164317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 733/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Thu May 26 17:55:26 2022] GET /identity/v3/projects => generated 2553 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:55:28.445007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a8c7-a9db-47a1-860d-1b90ab7e3e73 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:28.445582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a8c7-a9db-47a1-860d-1b90ab7e3e73 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:28.445582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594a8c7-a9db-47a1-860d-1b90ab7e3e73 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:28.447087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 746/1479] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:28.453163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd0916-1eaa-4a4b-8d83-a4885256156b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:28.453783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd0916-1eaa-4a4b-8d83-a4885256156b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:28.453783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd0916-1eaa-4a4b-8d83-a4885256156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:28.472287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c8cd0916-1eaa-4a4b-8d83-a4885256156b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:28.473493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8cd0916-1eaa-4a4b-8d83-a4885256156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:28.481493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 734/1480] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:55:28.527244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594a8c7-a9db-47a1-860d-1b90ab7e3e73 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:28.542521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594a8c7-a9db-47a1-860d-1b90ab7e3e73 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:28.547869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6b08a-279b-4a74-b965-1b1085bfde41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:28.548550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b08a-279b-4a74-b965-1b1085bfde41 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:28.548833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b08a-279b-4a74-b965-1b1085bfde41 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:28.549108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b08a-279b-4a74-b965-1b1085bfde41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:28.558391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b08a-279b-4a74-b965-1b1085bfde41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:28.559974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b08a-279b-4a74-b965-1b1085bfde41 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:28.570104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 747/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:55:31.005863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d70e5-d40e-4ba2-9b39-e15582d0d45c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:31.006469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d70e5-d40e-4ba2-9b39-e15582d0d45c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:31.006469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d70e5-d40e-4ba2-9b39-e15582d0d45c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:31.007797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 735/1482] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:31.014305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e27e2-11d7-4790-8d3c-9e09957d8688 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:31.014912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e27e2-11d7-4790-8d3c-9e09957d8688 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:31.014912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e27e2-11d7-4790-8d3c-9e09957d8688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:31.034136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-be8e27e2-11d7-4790-8d3c-9e09957d8688 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:31.035373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-be8e27e2-11d7-4790-8d3c-9e09957d8688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:31.044147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 748/1483] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:55:31.081322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d70e5-d40e-4ba2-9b39-e15582d0d45c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:31.092383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d70e5-d40e-4ba2-9b39-e15582d0d45c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:31.095885 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca09c2f-ab85-4a91-879f-e57a4e8c874c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:31.096564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09c2f-ab85-4a91-879f-e57a4e8c874c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:31.096850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09c2f-ab85-4a91-879f-e57a4e8c874c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:31.097128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09c2f-ab85-4a91-879f-e57a4e8c874c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:31.107287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca09c2f-ab85-4a91-879f-e57a4e8c874c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:31.108783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca09c2f-ab85-4a91-879f-e57a4e8c874c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:31.118501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 736/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:55:33.433204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9c0b5-a674-40fb-a809-6ce01fe28877 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.433750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9c0b5-a674-40fb-a809-6ce01fe28877 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.433750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9c0b5-a674-40fb-a809-6ce01fe28877 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.435155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 749/1485] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:33.440521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53207405-cca4-45af-9c3b-e2fc36bf2a5f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.440973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53207405-cca4-45af-9c3b-e2fc36bf2a5f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.441100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53207405-cca4-45af-9c3b-e2fc36bf2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.458404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-53207405-cca4-45af-9c3b-e2fc36bf2a5f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:33.459599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53207405-cca4-45af-9c3b-e2fc36bf2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:33.467821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 737/1486] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:55:33.506179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9c0b5-a674-40fb-a809-6ce01fe28877 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:33.518842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9c0b5-a674-40fb-a809-6ce01fe28877 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:33.522781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c5c63-4d73-43d4-9bfc-b2494778ff48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:33.523434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5c63-4d73-43d4-9bfc-b2494778ff48 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.523722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5c63-4d73-43d4-9bfc-b2494778ff48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.524002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5c63-4d73-43d4-9bfc-b2494778ff48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.533933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c5c63-4d73-43d4-9bfc-b2494778ff48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:33.535374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c5c63-4d73-43d4-9bfc-b2494778ff48 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:33.547008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 750/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:55:35.905020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646c34f-7a6b-4d3f-8eff-c56fcdf85a17 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:35.905622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646c34f-7a6b-4d3f-8eff-c56fcdf85a17 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:35.905622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646c34f-7a6b-4d3f-8eff-c56fcdf85a17 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:35.907070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 738/1488] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:35.913184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27331c7-bef7-452b-84a8-a74268ee2ea0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:35.913723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27331c7-bef7-452b-84a8-a74268ee2ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:35.913723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27331c7-bef7-452b-84a8-a74268ee2ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:35.933741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c27331c7-bef7-452b-84a8-a74268ee2ea0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:35.934977 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c27331c7-bef7-452b-84a8-a74268ee2ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:35.943076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 751/1489] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:55:35.983530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646c34f-7a6b-4d3f-8eff-c56fcdf85a17 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:35.995009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646c34f-7a6b-4d3f-8eff-c56fcdf85a17 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:35.998603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3cc6-bc48-418c-92cc-2667bfa4ac00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:35.999240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3cc6-bc48-418c-92cc-2667bfa4ac00 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:35.999528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3cc6-bc48-418c-92cc-2667bfa4ac00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:35.999812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3cc6-bc48-418c-92cc-2667bfa4ac00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:36.009957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3cc6-bc48-418c-92cc-2667bfa4ac00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:36.011410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3cc6-bc48-418c-92cc-2667bfa4ac00 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:36.021402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 739/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:55:38.540840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f2dbf-c126-41cb-a97d-84acd0af07bb None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:38.541510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f2dbf-c126-41cb-a97d-84acd0af07bb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:38.541617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f2dbf-c126-41cb-a97d-84acd0af07bb None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:38.543081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 752/1491] 10.222.0.69 () {54 vars in 926 bytes} [Thu May 26 17:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:55:38.549166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d6115-47d1-40ea-8583-41e27eb294a9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:38.549995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d6115-47d1-40ea-8583-41e27eb294a9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:38.549995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d6115-47d1-40ea-8583-41e27eb294a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:38.570275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cf7d6115-47d1-40ea-8583-41e27eb294a9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:38.571536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cf7d6115-47d1-40ea-8583-41e27eb294a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:38.579873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 740/1492] 10.222.0.69 () {58 vars in 1023 bytes} [Thu May 26 17:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:55:38.620852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f2dbf-c126-41cb-a97d-84acd0af07bb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:38.635429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f2dbf-c126-41cb-a97d-84acd0af07bb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:38.639402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f86e85-afb1-41ea-b091-8f4653893039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:38.640088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f86e85-afb1-41ea-b091-8f4653893039 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:38.640380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f86e85-afb1-41ea-b091-8f4653893039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:38.640656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f86e85-afb1-41ea-b091-8f4653893039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:38.651045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f86e85-afb1-41ea-b091-8f4653893039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:38.652533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f86e85-afb1-41ea-b091-8f4653893039 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:38.663193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 753/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:55:48.564364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=33 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:48.658219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=33 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:22.337138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e05e-4e0a-4c62-8450-8e0b8e72e823 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.337780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e05e-4e0a-4c62-8450-8e0b8e72e823 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.337780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e05e-4e0a-4c62-8450-8e0b8e72e823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.358364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9763e05e-4e0a-4c62-8450-8e0b8e72e823 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:57:22.359646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9763e05e-4e0a-4c62-8450-8e0b8e72e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:57:22.368520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 741/1494] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:57:22.379030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a1b0-5a6f-4f9e-80db-c89ee5f2233a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.379587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a1b0-5a6f-4f9e-80db-c89ee5f2233a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.379793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a1b0-5a6f-4f9e-80db-c89ee5f2233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.398176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5f30a1b0-5a6f-4f9e-80db-c89ee5f2233a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:57:22.399379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5f30a1b0-5a6f-4f9e-80db-c89ee5f2233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:57:22.407456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 754/1495] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:57:22.412811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e05e-4e0a-4c62-8450-8e0b8e72e823 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:22.423021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e05e-4e0a-4c62-8450-8e0b8e72e823 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:22.428847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:22.429512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.429798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.430077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.430841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:57:22.431151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:22.432212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:22.432212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 17:57:22.432212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 17:57:22.433106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:22.457023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 742/1496] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 17:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:57:22.465139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30a1b0-5a6f-4f9e-80db-c89ee5f2233a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:22.474595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30a1b0-5a6f-4f9e-80db-c89ee5f2233a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:22.479219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:22.480417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.480417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.480741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.481289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:22.483166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:22.483166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 26 17:57:22.483166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: May 26 17:57:22.484422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:22.531237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 755/1497] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 17:57:22 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:57:22.532407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:22.542936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778fcc-6aae-4050-a54e-3bb7fc2beecc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:22.606897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:22.607492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.607778 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.608151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.608863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:22.609880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:22.609880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 17:57:22.609880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 17:57:22.611070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:22.634688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 743/1498] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 17:57:22 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:57:22.639106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:22.649369 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8549-0c25-4bff-ae0a-44eb30405937 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:22.653996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:22.654655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.654940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.655229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.655948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:22.656983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:22.656983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 26 17:57:22.656983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: May 26 17:57:22.657871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:22.672573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 756/1499] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 17:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:57:22.677784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:22.688270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974ed1-3501-4133-9c2b-87a5d6d82762 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:22.693846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9fed4-aebd-4a40-bb96-0ab5a90f63d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:22.694534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9fed4-aebd-4a40-bb96-0ab5a90f63d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.694854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9fed4-aebd-4a40-bb96-0ab5a90f63d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.695135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9fed4-aebd-4a40-bb96-0ab5a90f63d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.695877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9fed4-aebd-4a40-bb96-0ab5a90f63d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:22.696947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-74e9fed4-aebd-4a40-bb96-0ab5a90f63d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:22.696947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 17:57:22.696947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 17:57:22.697854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9fed4-aebd-4a40-bb96-0ab5a90f63d8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:22.712055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 744/1500] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 17:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:57:22.716847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:22.727980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8653-9c49-4bda-ac51-4b33781547ff admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:22.732635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9cc0e-8d55-499a-9390-6e65027e7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:22.733520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9cc0e-8d55-499a-9390-6e65027e7a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.733809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9cc0e-8d55-499a-9390-6e65027e7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.734091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9cc0e-8d55-499a-9390-6e65027e7a41 admin admin] PATH_INFO: `/v3/projects/f9e1f47e2cda41c1a175bcfb36b38726/users/6c70ddd1c5f64ae5a4496cc02d30d5a6/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.753846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9cc0e-8d55-499a-9390-6e65027e7a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e1f47e2cda41c1a175bcfb36b38726, user_id=6c70ddd1c5f64ae5a4496cc02d30d5a6, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:22.754155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-47c9cc0e-8d55-499a-9390-6e65027e7a41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:22.754155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 26 17:57:22.754155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: May 26 17:57:22.756204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9cc0e-8d55-499a-9390-6e65027e7a41 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:22.778482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 757/1501] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 17:57:22 2022] PUT /identity/v3/projects/f9e1f47e2cda41c1a175bcfb36b38726/users/6c70ddd1c5f64ae5a4496cc02d30d5a6/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:57:22.790435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36ecc2-05bf-4867-b047-97c8632671db None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.790846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36ecc2-05bf-4867-b047-97c8632671db None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.791275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36ecc2-05bf-4867-b047-97c8632671db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.825129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9e36ecc2-05bf-4867-b047-97c8632671db None None] MFA Rules not processed for user `6c70ddd1c5f64ae5a4496cc02d30d5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:57:22.826508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9e36ecc2-05bf-4867-b047-97c8632671db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:57:22.897315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 745/1502] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:57:22.911399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177b048-d5b3-4760-b783-21dcd6479015 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.911670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177b048-d5b3-4760-b783-21dcd6479015 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.911970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177b048-d5b3-4760-b783-21dcd6479015 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.913426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 758/1503] 10.222.0.69 () {54 vars in 963 bytes} [Thu May 26 17:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 17:57:22.918882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a18f2-aa34-4939-854e-1bc54c97c0c8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:22.919184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a18f2-aa34-4939-854e-1bc54c97c0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:22.919471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a18f2-aa34-4939-854e-1bc54c97c0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:22.938604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a99a18f2-aa34-4939-854e-1bc54c97c0c8 None None] MFA Rules not processed for user `0d8e2195d53743f78c58cebdcd850fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:57:22.939821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a99a18f2-aa34-4939-854e-1bc54c97c0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:57:22.986010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:22.996719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 746/1504] 10.222.0.69 () {58 vars in 1060 bytes} [Thu May 26 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:57:23.004490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177b048-d5b3-4760-b783-21dcd6479015 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:23.015420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177b048-d5b3-4760-b783-21dcd6479015 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:23.020159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:23.020837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:23.021130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:23.021413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:23.030886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:23.032338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:23.042223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 759/1505] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:57:23.089385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602482c-642e-4a9a-8522-949b1cfcf385 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:23.089769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602482c-642e-4a9a-8522-949b1cfcf385 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:23.090099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602482c-642e-4a9a-8522-949b1cfcf385 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:23.091452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 747/1506] 10.222.0.69 () {52 vars in 829 bytes} [Thu May 26 17:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:57:23.095570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:23.163349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f017190-99f6-4e95-a016-b8a3173511bd service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:23.167958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:23.168875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:23.169159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:23.169437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] PATH_INFO: `/v3/users/6c70ddd1c5f64ae5a4496cc02d30d5a6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:23.170641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c70ddd1c5f64ae5a4496cc02d30d5a6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:23.171657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:23.171657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 26 17:57:23.171657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: May 26 17:57:23.172920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:23.243496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c70ddd1c5f64ae5a4496cc02d30d5a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:23.263976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c70ddd1c5f64ae5a4496cc02d30d5a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:23.274972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c70ddd1c5f64ae5a4496cc02d30d5a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:23.414709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:23.420729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c70ddd1c5f64ae5a4496cc02d30d5a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:23.421801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c70ddd1c5f64ae5a4496cc02d30d5a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:23.433827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 760/1507] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 17:57:23 2022] DELETE /identity/v3/users/6c70ddd1c5f64ae5a4496cc02d30d5a6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:57:23.438540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:23.439004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:23.439095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:23.459477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:57:23.460725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:57:23.523765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 748/1508] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:57:23.534082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:23.535516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:57:23.593028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824495a-04c0-4dea-ad7a-e4f557b2744e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:23.596692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57896a19-a2bd-46af-9130-8eab1e80ab4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:23.597378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896a19-a2bd-46af-9130-8eab1e80ab4e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:23.597664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896a19-a2bd-46af-9130-8eab1e80ab4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:23.597936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896a19-a2bd-46af-9130-8eab1e80ab4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:23.610112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57896a19-a2bd-46af-9130-8eab1e80ab4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:23.611546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57896a19-a2bd-46af-9130-8eab1e80ab4e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:23.621789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 761/1509] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:57:24.021788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:57:24.023469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:57:24.039012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45510f-681c-40d1-a841-7424c2bf4ff2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:57:24.046986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:57:24.048505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:57:24.049004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:57:24.050386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] PATH_INFO: `/v3/projects/f9e1f47e2cda41c1a175bcfb36b38726` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:57:24.052514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e1f47e2cda41c1a175bcfb36b38726)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:57:24.054388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:24.054388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 17:57:24.054388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 17:57:24.056742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:57:24.145552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e1f47e2cda41c1a175bcfb36b38726', 'request_id': 'req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:24.158195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e1f47e2cda41c1a175bcfb36b38726', 'request_id': 'req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:24.166842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e1f47e2cda41c1a175bcfb36b38726', 'request_id': 'req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:24.188409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] The token cache is being invalidate because project f9e1f47e2cda41c1a175bcfb36b38726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:57:24.188693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:24.189454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a8d16394-2be2-462a-a4a5-4e0ca9a5e0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:57:24.191641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 749/1510] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 17:57:24 2022] DELETE /identity/v3/projects/f9e1f47e2cda41c1a175bcfb36b38726 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:57:33.617128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=29 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:34.185226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:08.528550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217783cf-b226-4b87-b15f-90c27745e5a3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:08.529274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217783cf-b226-4b87-b15f-90c27745e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:08.529274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217783cf-b226-4b87-b15f-90c27745e5a3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:08.530624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:08.536952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd08d7-b6b7-4206-a934-a4b0c4ab5fd2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:08.537699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd08d7-b6b7-4206-a934-a4b0c4ab5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:08.537699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd08d7-b6b7-4206-a934-a4b0c4ab5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:08.557649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-45cd08d7-b6b7-4206-a934-a4b0c4ab5fd2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:08.558914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-45cd08d7-b6b7-4206-a934-a4b0c4ab5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:08.623319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:08.810528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217783cf-b226-4b87-b15f-90c27745e5a3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:08.812495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-217783cf-b226-4b87-b15f-90c27745e5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:08.901257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217783cf-b226-4b87-b15f-90c27745e5a3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:08.907292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a523-bc7d-4969-b03d-7c082dce1cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:08.907968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a523-bc7d-4969-b03d-7c082dce1cd3 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:08.908288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a523-bc7d-4969-b03d-7c082dce1cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:08.908560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a523-bc7d-4969-b03d-7c082dce1cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:08.917918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a523-bc7d-4969-b03d-7c082dce1cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:08.919709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a523-bc7d-4969-b03d-7c082dce1cd3 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:08.930439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 763/1513] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:09.433773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0260a9-e0d0-4f57-88ad-07955d7193e8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:09.436114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0260a9-e0d0-4f57-88ad-07955d7193e8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:09.436416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0260a9-e0d0-4f57-88ad-07955d7193e8 None None] PATH_INFO: `/v3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:09.437805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 751/1514] 10.222.0.62 () {54 vars in 925 bytes} [Thu May 26 17:59:09 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:59:09.444253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6d654-6c71-48c3-b410-ca126403e1d0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:09.444539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6d654-6c71-48c3-b410-ca126403e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:09.444840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6d654-6c71-48c3-b410-ca126403e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:09.466675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-20d6d654-6c71-48c3-b410-ca126403e1d0 None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:09.468192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-20d6d654-6c71-48c3-b410-ca126403e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:09.550451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 764/1515] 10.222.0.62 () {58 vars in 1015 bytes} [Thu May 26 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:09.876001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22b9b-ae7e-42a2-9851-424fd86e9cc1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:09.876698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22b9b-ae7e-42a2-9851-424fd86e9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:09.876859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22b9b-ae7e-42a2-9851-424fd86e9cc1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:09.878334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 752/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:09.883559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b754-4e26-4511-917d-172f22a3a890 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:09.883895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b754-4e26-4511-917d-172f22a3a890 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:09.884247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b754-4e26-4511-917d-172f22a3a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:09.905926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0896b754-4e26-4511-917d-172f22a3a890 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:09.907146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0896b754-4e26-4511-917d-172f22a3a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:09.915222 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 765/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:59:10.073316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22b9b-ae7e-42a2-9851-424fd86e9cc1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:10.089284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22b9b-ae7e-42a2-9851-424fd86e9cc1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:10.095606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1690787-b561-4ee8-83d2-d439a3695661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:10.096294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690787-b561-4ee8-83d2-d439a3695661 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:10.096583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690787-b561-4ee8-83d2-d439a3695661 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:10.096863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690787-b561-4ee8-83d2-d439a3695661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:10.106253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1690787-b561-4ee8-83d2-d439a3695661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:10.107885 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1690787-b561-4ee8-83d2-d439a3695661 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:10.118605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 753/1518] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:13.442298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc314c5-653a-4198-903e-f479faff2de5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:13.442854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc314c5-653a-4198-903e-f479faff2de5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:13.442854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc314c5-653a-4198-903e-f479faff2de5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:13.444255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 766/1519] 10.222.0.69 () {54 vars in 960 bytes} [Thu May 26 17:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:13.450127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca437038-30c5-4634-8666-0baa5851f44a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:13.450602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca437038-30c5-4634-8666-0baa5851f44a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:13.450707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca437038-30c5-4634-8666-0baa5851f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:13.468869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ca437038-30c5-4634-8666-0baa5851f44a None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:13.470073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca437038-30c5-4634-8666-0baa5851f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:13.478627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 754/1520] 10.222.0.69 () {58 vars in 1057 bytes} [Thu May 26 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:13.486694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc314c5-653a-4198-903e-f479faff2de5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:13.502334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc314c5-653a-4198-903e-f479faff2de5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:13.507167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba189a0-e5e4-4392-b640-e9ba22d3b14e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:13.507805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba189a0-e5e4-4392-b640-e9ba22d3b14e service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:13.508116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba189a0-e5e4-4392-b640-e9ba22d3b14e service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:13.508397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba189a0-e5e4-4392-b640-e9ba22d3b14e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:13.518053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba189a0-e5e4-4392-b640-e9ba22d3b14e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:13.519625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba189a0-e5e4-4392-b640-e9ba22d3b14e service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:13.529944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 767/1521] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:21.425132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88367d3-e829-4460-9913-0fd1f0ce3cff None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:21.425685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88367d3-e829-4460-9913-0fd1f0ce3cff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:21.425685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88367d3-e829-4460-9913-0fd1f0ce3cff None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:21.427055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:21.431848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf61b2-300a-4419-96d2-a1b7be227190 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:21.432285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf61b2-300a-4419-96d2-a1b7be227190 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:21.432434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf61b2-300a-4419-96d2-a1b7be227190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:21.451564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fadf61b2-300a-4419-96d2-a1b7be227190 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:21.452785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fadf61b2-300a-4419-96d2-a1b7be227190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:21.460474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:21.628602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88367d3-e829-4460-9913-0fd1f0ce3cff None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:21.643929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88367d3-e829-4460-9913-0fd1f0ce3cff None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:21.649369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2eb0e-5a0b-4409-9da9-0f191cb08d8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:21.650010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2eb0e-5a0b-4409-9da9-0f191cb08d8b service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:21.650293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2eb0e-5a0b-4409-9da9-0f191cb08d8b service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:21.650568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2eb0e-5a0b-4409-9da9-0f191cb08d8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:21.659207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2eb0e-5a0b-4409-9da9-0f191cb08d8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:21.660830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2eb0e-5a0b-4409-9da9-0f191cb08d8b service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:21.670332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 756/1524] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:22.554028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc17dd5-9951-4ae2-8abd-d9b4c7760780 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:22.554732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc17dd5-9951-4ae2-8abd-d9b4c7760780 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:22.554732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc17dd5-9951-4ae2-8abd-d9b4c7760780 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:22.555893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 17:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:22.564362 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94e6d-fd1c-4bf5-9c3a-7d916a2514b9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:22.564907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94e6d-fd1c-4bf5-9c3a-7d916a2514b9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:22.564907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94e6d-fd1c-4bf5-9c3a-7d916a2514b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:22.586710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7ea94e6d-fd1c-4bf5-9c3a-7d916a2514b9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:22.587924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7ea94e6d-fd1c-4bf5-9c3a-7d916a2514b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:22.596034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 17:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:22.748998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc17dd5-9951-4ae2-8abd-d9b4c7760780 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:22.763526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc17dd5-9951-4ae2-8abd-d9b4c7760780 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:22.769075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df08b-d5bb-40f2-a6a3-3f670a610cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:22.769640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df08b-d5bb-40f2-a6a3-3f670a610cb8 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:22.769926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df08b-d5bb-40f2-a6a3-3f670a610cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:22.770204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df08b-d5bb-40f2-a6a3-3f670a610cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:22.778851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df08b-d5bb-40f2-a6a3-3f670a610cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:22.780468 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df08b-d5bb-40f2-a6a3-3f670a610cb8 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:22.790069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 770/1527] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:26.909347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420f7ab-b40f-40c6-974e-bf83bca6730f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:26.909992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420f7ab-b40f-40c6-974e-bf83bca6730f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:26.909992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420f7ab-b40f-40c6-974e-bf83bca6730f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:26.911297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:26.917211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f057-fbc4-4176-861e-27d24e17bdb6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:26.918116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f057-fbc4-4176-861e-27d24e17bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:26.918522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f057-fbc4-4176-861e-27d24e17bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:26.938870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0bc0f057-fbc4-4176-861e-27d24e17bdb6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:26.940139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0bc0f057-fbc4-4176-861e-27d24e17bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:26.948253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:26.984787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420f7ab-b40f-40c6-974e-bf83bca6730f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:26.986721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5420f7ab-b40f-40c6-974e-bf83bca6730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:27.046980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420f7ab-b40f-40c6-974e-bf83bca6730f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:27.050538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2502a30-eb98-4fdb-9c69-70def9e1b3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:27.051199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502a30-eb98-4fdb-9c69-70def9e1b3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:27.051485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502a30-eb98-4fdb-9c69-70def9e1b3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:27.051772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502a30-eb98-4fdb-9c69-70def9e1b3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:27.061672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2502a30-eb98-4fdb-9c69-70def9e1b3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:27.063142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2502a30-eb98-4fdb-9c69-70def9e1b3b8 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:27.073319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 759/1530] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:29.351832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050ff70-cf7b-476d-a13e-a79adb60f0c7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:29.352436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050ff70-cf7b-476d-a13e-a79adb60f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:29.352436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050ff70-cf7b-476d-a13e-a79adb60f0c7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:29.353814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:29.359962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d069b7-c429-47fa-8039-61c00e2b3c99 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:29.360500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d069b7-c429-47fa-8039-61c00e2b3c99 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:29.360595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d069b7-c429-47fa-8039-61c00e2b3c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:29.389140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-35d069b7-c429-47fa-8039-61c00e2b3c99 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:29.390267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-35d069b7-c429-47fa-8039-61c00e2b3c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:29.398270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:29.435092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050ff70-cf7b-476d-a13e-a79adb60f0c7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:29.446056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050ff70-cf7b-476d-a13e-a79adb60f0c7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:29.449594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831626-e34f-44b8-90c4-8eab6b8c5b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:29.450235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831626-e34f-44b8-90c4-8eab6b8c5b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:29.450520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831626-e34f-44b8-90c4-8eab6b8c5b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:29.450806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831626-e34f-44b8-90c4-8eab6b8c5b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:29.460520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2831626-e34f-44b8-90c4-8eab6b8c5b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:29.461962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2831626-e34f-44b8-90c4-8eab6b8c5b55 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:29.472504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 773/1533] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:33.343005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1f9fc-0f0b-4b5e-85e8-c4e01067155a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:33.343547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1f9fc-0f0b-4b5e-85e8-c4e01067155a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:33.343547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1f9fc-0f0b-4b5e-85e8-c4e01067155a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:33.345060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:33.350633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318a6e-f684-45d8-bd0f-8267907ee767 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:33.351046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318a6e-f684-45d8-bd0f-8267907ee767 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:33.351187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318a6e-f684-45d8-bd0f-8267907ee767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:33.376123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-63318a6e-f684-45d8-bd0f-8267907ee767 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:33.377330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-63318a6e-f684-45d8-bd0f-8267907ee767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:33.385359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:33.663356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1f9fc-0f0b-4b5e-85e8-c4e01067155a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:33.665097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99f1f9fc-0f0b-4b5e-85e8-c4e01067155a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:33.725759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1f9fc-0f0b-4b5e-85e8-c4e01067155a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:33.729956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5ffdc-ab4c-474b-afea-0e43edfa82cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:33.730612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ffdc-ab4c-474b-afea-0e43edfa82cb service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:33.730898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ffdc-ab4c-474b-afea-0e43edfa82cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:33.731187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ffdc-ab4c-474b-afea-0e43edfa82cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:33.740824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5ffdc-ab4c-474b-afea-0e43edfa82cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:33.742274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5ffdc-ab4c-474b-afea-0e43edfa82cb service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:33.747530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:33.752991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 762/1536] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:36.024640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1443-612a-4344-944b-b4bc63061d97 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:36.025190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1443-612a-4344-944b-b4bc63061d97 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:36.025190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1443-612a-4344-944b-b4bc63061d97 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:36.026684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 17:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:59:36.032066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304c16-4c3a-49bd-b630-4da96c8e4c9a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:36.032582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304c16-4c3a-49bd-b630-4da96c8e4c9a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:36.032727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304c16-4c3a-49bd-b630-4da96c8e4c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:36.051129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-df304c16-4c3a-49bd-b630-4da96c8e4c9a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:59:36.052387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df304c16-4c3a-49bd-b630-4da96c8e4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:36.060951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 17:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:59:36.339486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff1443-612a-4344-944b-b4bc63061d97 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:59:36.341210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d1ff1443-612a-4344-944b-b4bc63061d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:59:36.348784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:36.355862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff1443-612a-4344-944b-b4bc63061d97 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:59:36.359598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccadf31-9ac9-451e-848e-aac45f1b1bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:59:36.360340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadf31-9ac9-451e-848e-aac45f1b1bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:59:36.360624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadf31-9ac9-451e-848e-aac45f1b1bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:59:36.362544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadf31-9ac9-451e-848e-aac45f1b1bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:59:36.371627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadf31-9ac9-451e-848e-aac45f1b1bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:59:36.373141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadf31-9ac9-451e-848e-aac45f1b1bfc service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:59:36.383221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 776/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 17:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:59:46.045804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:46.378910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:07.442289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fd26-2636-4f99-bd1e-03f182315cb8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.443489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fd26-2636-4f99-bd1e-03f182315cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.444116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fd26-2636-4f99-bd1e-03f182315cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.476226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fa48fd26-2636-4f99-bd1e-03f182315cb8 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.477903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fa48fd26-2636-4f99-bd1e-03f182315cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.492740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 764/1540] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.504284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178307f-ad48-4d1b-80ba-8327c71b4274 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.505932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178307f-ad48-4d1b-80ba-8327c71b4274 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.506447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178307f-ad48-4d1b-80ba-8327c71b4274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.538593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8178307f-ad48-4d1b-80ba-8327c71b4274 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.540769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8178307f-ad48-4d1b-80ba-8327c71b4274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.553001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 777/1541] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.557601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48fd26-2636-4f99-bd1e-03f182315cb8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:07.570957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7a38-905e-4a9a-9c44-541bf4037fde None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.573722 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48fd26-2636-4f99-bd1e-03f182315cb8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:07.574891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7a38-905e-4a9a-9c44-541bf4037fde None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.576221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7a38-905e-4a9a-9c44-541bf4037fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.585240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7da27-ebc9-46b5-97e4-d686f8509e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:07.587772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7da27-ebc9-46b5-97e4-d686f8509e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.588502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7da27-ebc9-46b5-97e4-d686f8509e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.591048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7da27-ebc9-46b5-97e4-d686f8509e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.592235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7da27-ebc9-46b5-97e4-d686f8509e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:07.592800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7da27-ebc9-46b5-97e4-d686f8509e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:07.596366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7da27-ebc9-46b5-97e4-d686f8509e0b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:07.622800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-849c7a38-905e-4a9a-9c44-541bf4037fde None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.624959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-849c7a38-905e-4a9a-9c44-541bf4037fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.627767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 765/1542] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:07.629579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbaffd-78ea-446e-872b-61f0cd2e7895 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.631378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbaffd-78ea-446e-872b-61f0cd2e7895 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.633190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbaffd-78ea-446e-872b-61f0cd2e7895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.650469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 778/1543] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.656376 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8e33-aff8-4778-8133-7777fe06e848 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.657036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8e33-aff8-4778-8133-7777fe06e848 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.657655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8e33-aff8-4778-8133-7777fe06e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.672975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-defbaffd-78ea-446e-872b-61f0cd2e7895 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.675931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-defbaffd-78ea-446e-872b-61f0cd2e7895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.693532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-500b8e33-aff8-4778-8133-7777fe06e848 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.695199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-500b8e33-aff8-4778-8133-7777fe06e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.706684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 766/1544] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.707550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbaffd-78ea-446e-872b-61f0cd2e7895 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:07.721415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 779/1545] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.722827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d0b32-b8e2-4c1c-92ee-b2459053599a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.723115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d0b32-b8e2-4c1c-92ee-b2459053599a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.723392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d0b32-b8e2-4c1c-92ee-b2459053599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.740712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbaffd-78ea-446e-872b-61f0cd2e7895 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:07.772150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c462-c064-4c0f-a9bb-ee5b417e916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:07.773040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c462-c064-4c0f-a9bb-ee5b417e916e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.773336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c462-c064-4c0f-a9bb-ee5b417e916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.773667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c462-c064-4c0f-a9bb-ee5b417e916e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.774457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159c462-c064-4c0f-a9bb-ee5b417e916e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:07.775588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-6159c462-c064-4c0f-a9bb-ee5b417e916e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:01:07.775588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 18:01:07.775588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 18:01:07.787000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159c462-c064-4c0f-a9bb-ee5b417e916e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:07.798570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d39d0b32-b8e2-4c1c-92ee-b2459053599a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.799819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d39d0b32-b8e2-4c1c-92ee-b2459053599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.820796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 780/1546] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.823195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeded0d-761d-46c3-bf23-ce42c4b855a0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.823195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeded0d-761d-46c3-bf23-ce42c4b855a0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.823195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeded0d-761d-46c3-bf23-ce42c4b855a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.841179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 767/1547] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:07.842754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dfa07-0da0-40b6-8a87-c04504246fcf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.843109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dfa07-0da0-40b6-8a87-c04504246fcf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.843454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dfa07-0da0-40b6-8a87-c04504246fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.853413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7aeded0d-761d-46c3-bf23-ce42c4b855a0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.855179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7aeded0d-761d-46c3-bf23-ce42c4b855a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.863245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-408dfa07-0da0-40b6-8a87-c04504246fcf None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.865164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-408dfa07-0da0-40b6-8a87-c04504246fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.928677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 768/1548] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.930171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca447-366a-4698-87b3-e84e0b18b9e1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.930475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca447-366a-4698-87b3-e84e0b18b9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.930764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca447-366a-4698-87b3-e84e0b18b9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.938103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 781/1549] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.939459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becfbd6-5605-4894-9b81-a2c8bd1c87a7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.939749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becfbd6-5605-4894-9b81-a2c8bd1c87a7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.940060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becfbd6-5605-4894-9b81-a2c8bd1c87a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.960963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-92dca447-366a-4698-87b3-e84e0b18b9e1 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.961404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6becfbd6-5605-4894-9b81-a2c8bd1c87a7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.962224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92dca447-366a-4698-87b3-e84e0b18b9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.962620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6becfbd6-5605-4894-9b81-a2c8bd1c87a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.970465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 769/1550] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.970984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 782/1551] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:07.980293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becfbd6-5605-4894-9b81-a2c8bd1c87a7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:07.980548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a9c9-e2ce-4163-a9d9-1e313de9a88a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.980548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a9c9-e2ce-4163-a9d9-1e313de9a88a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.980548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a9c9-e2ce-4163-a9d9-1e313de9a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.986279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becfbd6-5605-4894-9b81-a2c8bd1c87a7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:07.991526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:07.992241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:07.992535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:07.992817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:07.993556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:07.993868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:07.994383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bdc6a9c9-e2ce-4163-a9d9-1e313de9a88a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:07.994904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:01:07.994904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 26 18:01:07.994904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: May 26 18:01:07.995616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bdc6a9c9-e2ce-4163-a9d9-1e313de9a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:07.995802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.003733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 770/1552] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:08.005218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554864-5d3d-47f0-b0c8-2487f714863f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.005518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554864-5d3d-47f0-b0c8-2487f714863f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.005817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554864-5d3d-47f0-b0c8-2487f714863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.011313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 783/1553] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:08.012776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.031854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b0554864-5d3d-47f0-b0c8-2487f714863f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:08.033103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0554864-5d3d-47f0-b0c8-2487f714863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:08.034614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bedbf2-8060-43a0-b6f8-4696e555985e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.040441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe4eac-c610-4f05-87e8-b226a5d13fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.041160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe4eac-c610-4f05-87e8-b226a5d13fce admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.041447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe4eac-c610-4f05-87e8-b226a5d13fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.041728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe4eac-c610-4f05-87e8-b226a5d13fce admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.042150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 771/1554] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:08.042458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe4eac-c610-4f05-87e8-b226a5d13fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.043809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-9efe4eac-c610-4f05-87e8-b226a5d13fce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:01:08.043809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 26 18:01:08.043809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: May 26 18:01:08.045140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554864-5d3d-47f0-b0c8-2487f714863f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.045598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe4eac-c610-4f05-87e8-b226a5d13fce admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.059446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554864-5d3d-47f0-b0c8-2487f714863f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.065417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.066155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.066439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.066713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.067485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:08.067768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.069569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.072676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 784/1555] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/users => generated 283 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.074124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14adf2-2528-42e3-8f47-01b117319451 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.074422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14adf2-2528-42e3-8f47-01b117319451 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.074703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14adf2-2528-42e3-8f47-01b117319451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.086027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 772/1556] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:08.089179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.097749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d639b-588b-4f24-83b7-17140aa2f948 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.099989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3c14adf2-2528-42e3-8f47-01b117319451 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:08.101497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c14adf2-2528-42e3-8f47-01b117319451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:08.103020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498775-7223-4acd-8239-5ad07b5a3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.103684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498775-7223-4acd-8239-5ad07b5a3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.103969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498775-7223-4acd-8239-5ad07b5a3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.104280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498775-7223-4acd-8239-5ad07b5a3f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.105011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498775-7223-4acd-8239-5ad07b5a3f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:08.105320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498775-7223-4acd-8239-5ad07b5a3f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.106917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498775-7223-4acd-8239-5ad07b5a3f92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.109803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 785/1557] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:08.110880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d210f0-e3e0-490f-a97a-1788b8b2cf33 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.111438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d210f0-e3e0-490f-a97a-1788b8b2cf33 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.111716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d210f0-e3e0-490f-a97a-1788b8b2cf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.126001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 773/1558] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:08.127400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874626eb-650a-4084-b42e-9fabbeaa8c86 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.127755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874626eb-650a-4084-b42e-9fabbeaa8c86 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.128060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874626eb-650a-4084-b42e-9fabbeaa8c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.130800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-41d210f0-e3e0-490f-a97a-1788b8b2cf33 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:08.132134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-41d210f0-e3e0-490f-a97a-1788b8b2cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:08.140069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 786/1559] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:08.140874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d210f0-e3e0-490f-a97a-1788b8b2cf33 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.150727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d210f0-e3e0-490f-a97a-1788b8b2cf33 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.150954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-874626eb-650a-4084-b42e-9fabbeaa8c86 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:08.152133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-874626eb-650a-4084-b42e-9fabbeaa8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:08.155424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.156132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.156425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.156705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.157475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.159463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.160637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 774/1560] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:08.165087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb111bb-ef5c-4c9c-8485-7c65510a0bc9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.165087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb111bb-ef5c-4c9c-8485-7c65510a0bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.165087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb111bb-ef5c-4c9c-8485-7c65510a0bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.183307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7bb111bb-ef5c-4c9c-8485-7c65510a0bc9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:08.184541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7bb111bb-ef5c-4c9c-8485-7c65510a0bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:08.190080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 787/1561] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.191031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.194093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 775/1562] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:08.194936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb111bb-ef5c-4c9c-8485-7c65510a0bc9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.204842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb111bb-ef5c-4c9c-8485-7c65510a0bc9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.255019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:08.256052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1429cf-5b82-44b8-9314-69fade0a747e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.262217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.262939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.263229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.263513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.264346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.266022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.266192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.266890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.267182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.267461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.268199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.268625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:08.270222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.279302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 788/1563] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:08.280257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.291833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d6997-a4b6-4366-94c9-10ec0b1828de admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.297478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.297928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.298300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.298558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.299319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:08.299630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.301395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.307165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 776/1564] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.307165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.319838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 789/1565] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:08.319838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.329411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3f52-f49e-45a4-8ead-8da700bd5066 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.374587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08cf5-61df-4ee3-b18d-9d71d71628a8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.379662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.380865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.381150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.381441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.382210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.384144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.395258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.396950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.397358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.397640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.398378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:08.398685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.400351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.414626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 777/1566] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.414626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.419238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 790/1567] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:08.420131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.431350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cba7b-98d3-4c09-8df1-92b6e8676bf2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.491590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bb4e4-ea04-4678-9e81-f1349246ab8e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.497741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.498453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.498793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.498947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.499119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.499725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.499896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:08.500074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.500233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.500384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.501031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.501939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.502930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.519180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 778/1568] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:08.520093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.532217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 791/1569] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.533092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.538063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a208a37-9387-4865-b921-a8904a135bba admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.545140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.545356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71e1f-1d7c-4b49-8cd1-d6ebecfe2401 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.545836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.546127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.546408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.547148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:08.547460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.549143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.550144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.550842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.551123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.551399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.552324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.553910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.571509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 779/1570] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:08.571763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 792/1571] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:08.571763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.571955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.581861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2cb6-b8d8-48df-aaf5-213f39c29530 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.582099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727207b4-89b4-4aba-8924-61675a7962e2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.587423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.588130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.588306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.588451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.588685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.589022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.589337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.589483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.589649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.590369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.591356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.592529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.619701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 793/1572] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.620857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.621728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 780/1573] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.622419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.634938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c4f4-4463-4e69-aacc-615bbff271b3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.663875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:08.674007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:08.699224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ac6d-7351-4ed9-ac93-3fa9480daf63 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.703824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.704534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.704897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.705237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.706015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.706401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.707076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.707366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.707647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.707934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.709062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.711494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.731456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 794/1574] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.732656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.741962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 781/1575] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.745558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.745987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87210370-5fae-4d95-87ca-473e924864a8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.812773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.813362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.813672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.813947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.814734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.816721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ffecc-8981-410b-a149-fcc7da75cf32 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.817009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.822375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.823065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.823353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.823631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.824522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.826631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.836940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 782/1576] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:08.837769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.850980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 795/1577] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.851206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755f5aa-259d-4df2-a921-8808e6803058 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.851325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.912135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.913190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.913477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.913758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] PATH_INFO: `/v3/projects/04bc982b9b3d40e0a44205e852c649f0/users/e7cabc3c48a34cad98b2b0a7886fc36b/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.915685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287189d-1405-40ba-a5a1-59897717dcb4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:08.920355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:08.921021 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:08.921305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:08.921583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:08.922313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.924253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.930102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bc982b9b3d40e0a44205e852c649f0, user_id=e7cabc3c48a34cad98b2b0a7886fc36b, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:08.931156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:01:08.931156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 18:01:08.931156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 18:01:08.933316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:08.948593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 783/1578] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:08 2022] PUT /identity/v3/projects/04bc982b9b3d40e0a44205e852c649f0/users/e7cabc3c48a34cad98b2b0a7886fc36b/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:08.953256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 796/1579] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:08.953256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.957821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:08.995748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:08.996709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:09.027567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5d82-6750-496c-8ce6-bc336fefd909 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.028234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ca387-dbd0-4771-a25a-4473e48481ae admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.032602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.032949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.033284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.033568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.033687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.033843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.033977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.034194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.034708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.034902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.036940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.038722 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.048299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 797/1580] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.049280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.060735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cc479-8883-401f-8de2-f4b84eb2aa8b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.065583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 784/1581] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:08 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:09.065583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.065830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.066439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.066798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.067148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.068795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.070136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.074567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858d4fa-f6b5-4bb5-8fc2-ad4408f80fe7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.079513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.080265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.080522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 798/1582] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.084649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.084649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.084649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.084949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.085041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.093867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca41b1-217e-4f8c-ada7-dd1456c09c55 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.098894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.099635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.099924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.100253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.100980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.102592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.106545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 785/1583] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:09 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:09.107429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.116083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 799/1584] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.118562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300fd8-35de-4989-bdb6-2953db3a3750 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.119049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.123473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99415a-a3a4-4744-a3e6-56d773eee5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.124177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99415a-a3a4-4744-a3e6-56d773eee5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.124463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99415a-a3a4-4744-a3e6-56d773eee5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.124741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99415a-a3a4-4744-a3e6-56d773eee5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.125434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99415a-a3a4-4744-a3e6-56d773eee5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.127398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99415a-a3a4-4744-a3e6-56d773eee5e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.129411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2821e9-aa99-477f-b3e8-e888fcd99fd8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.135455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.136965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.137320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.137714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.138416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.140898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.153228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 786/1585] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:09 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:09.153228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc2de-dcb5-4570-bc3b-0ce3b1b2a8f3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.153228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc2de-dcb5-4570-bc3b-0ce3b1b2a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.153228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc2de-dcb5-4570-bc3b-0ce3b1b2a8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.168046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 800/1586] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:09 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:09.168046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.177930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d43d-f667-4a7e-9719-11a7eb78b5dd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.183003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.183688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.183974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.184285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.185017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.186245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9fbdc2de-dcb5-4570-bc3b-0ce3b1b2a8f3 None None] MFA Rules not processed for user `e7cabc3c48a34cad98b2b0a7886fc36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:09.186624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.187475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9fbdc2de-dcb5-4570-bc3b-0ce3b1b2a8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:09.199329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 801/1587] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.207663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.220057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100e58-d004-405f-98b0-a32c77313ae8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.226601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.227466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.227653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.228031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.228805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.230527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.242764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 802/1588] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.243608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.253598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dea067-fb52-4f2c-99b7-ed3ace16996a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.259623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.260348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.260674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.261161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.262192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.264188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.264667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 787/1589] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:09.268946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc2de-dcb5-4570-bc3b-0ce3b1b2a8f3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.279020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 803/1590] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.279020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.284222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc2de-dcb5-4570-bc3b-0ce3b1b2a8f3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.287292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069bfe-9fc0-44b3-9c19-568ec5cdb7ba admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.289672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.290446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.290765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.291017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.291972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.292517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.293534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.293643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.293823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.294152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] PATH_INFO: `/v3/projects/ab53cc69f7b0424cb689317c4be9b685/users/a7cc6fcd7b4c4cee8d21e2692757aaf6/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.304466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 788/1591] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.305307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.313569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab53cc69f7b0424cb689317c4be9b685, user_id=a7cc6fcd7b4c4cee8d21e2692757aaf6, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.315130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb21bd-db80-4329-aa7c-64249990f17e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.316646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.321136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.322062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.322350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.322760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.323424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.325558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.332946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 804/1592] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:09 2022] PUT /identity/v3/projects/ab53cc69f7b0424cb689317c4be9b685/users/a7cc6fcd7b4c4cee8d21e2692757aaf6/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:09.334631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.345652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 789/1593] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.350469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.359594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25883c7-7d03-4bfa-a3b0-dded68520051 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.404638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258e699-9014-4a1b-aed5-07baef3e95d1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.409943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.410628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.410919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.411114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:09.411788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.412603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.414388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.423520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.424448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.424732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.425011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] PATH_INFO: `/v3/projects/41aaf61888b149a59ed741d201490e52/users/9caae6984c3b47c59f8b385af0b40f98/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.425471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 805/1594] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.426306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.437181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c402c6-38a0-4057-a402-283878d930f3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.442595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.443331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41aaf61888b149a59ed741d201490e52, user_id=9caae6984c3b47c59f8b385af0b40f98, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.443506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.443775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.444156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.444880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.445546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.446582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.458542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 806/1595] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.460058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.461533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 790/1596] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:09 2022] PUT /identity/v3/projects/41aaf61888b149a59ed741d201490e52/users/9caae6984c3b47c59f8b385af0b40f98/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:09.462327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.492600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:09.529341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379ddc-86bb-40cc-b488-8d379e51e46a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.532591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6615271-2985-40c7-b245-e0a1222f2cb9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.534568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.535502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.535795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.537108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] PATH_INFO: `/v3/projects/79f8f4d1e7da4bfe9629717a86ba0def/users/a95761f42af64635b051051e397d0fd1/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.554148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f8f4d1e7da4bfe9629717a86ba0def, user_id=a95761f42af64635b051051e397d0fd1, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.556864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.571732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 791/1597] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:09 2022] PUT /identity/v3/projects/79f8f4d1e7da4bfe9629717a86ba0def/users/a95761f42af64635b051051e397d0fd1/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:09.572208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.593086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.593819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.594154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.594477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.639442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c8c3-b763-48b9-9b97-b1ed2636801e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.644532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3422ab-5a4f-4737-acec-88203ccd4b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.645207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3422ab-5a4f-4737-acec-88203ccd4b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.646014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3422ab-5a4f-4737-acec-88203ccd4b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.646330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3422ab-5a4f-4737-acec-88203ccd4b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.647072 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3422ab-5a4f-4737-acec-88203ccd4b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.648749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3422ab-5a4f-4737-acec-88203ccd4b3e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.656630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.658141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.659965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 792/1598] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.661819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4f341-4656-4983-b92b-fa546de40925 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.662193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4f341-4656-4983-b92b-fa546de40925 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.662481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4f341-4656-4983-b92b-fa546de40925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.669853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 807/1599] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:09.670791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.682352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f7ef0-6276-43ba-a39b-5c674fb172c0 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.683685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-69f4f341-4656-4983-b92b-fa546de40925 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:09.685727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-69f4f341-4656-4983-b92b-fa546de40925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:09.687431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.688138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.688426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.688706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.689443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.691064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.695525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 793/1600] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:09.697043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4f341-4656-4983-b92b-fa546de40925 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.711549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 808/1601] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.711549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.715826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4f341-4656-4983-b92b-fa546de40925 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.719660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2d628-d8f7-447d-b71f-742765c3c33b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.720564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749bbbf-9051-454a-abb1-dbed5a359b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.721234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749bbbf-9051-454a-abb1-dbed5a359b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.721524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749bbbf-9051-454a-abb1-dbed5a359b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.721807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749bbbf-9051-454a-abb1-dbed5a359b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.722542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749bbbf-9051-454a-abb1-dbed5a359b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.724272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749bbbf-9051-454a-abb1-dbed5a359b7a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.725414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.726511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.726894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.727266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] PATH_INFO: `/v3/projects/421956e14b9e4148995a4dde9c971988/users/2725a0401fc04904adf55f7c72281e3a/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.736781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 794/1602] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:09.738547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09210af8-88d5-4455-ae78-f7c1c1bf88fd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.739045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09210af8-88d5-4455-ae78-f7c1c1bf88fd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.740049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09210af8-88d5-4455-ae78-f7c1c1bf88fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.749817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=421956e14b9e4148995a4dde9c971988, user_id=2725a0401fc04904adf55f7c72281e3a, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.753057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.767449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-09210af8-88d5-4455-ae78-f7c1c1bf88fd None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:09.769646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-09210af8-88d5-4455-ae78-f7c1c1bf88fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:09.782158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 795/1603] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:09.784049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3c162-16b8-4571-92e6-1afcf7f93d8b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.784357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3c162-16b8-4571-92e6-1afcf7f93d8b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.784640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3c162-16b8-4571-92e6-1afcf7f93d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.792197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 809/1604] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:09 2022] PUT /identity/v3/projects/421956e14b9e4148995a4dde9c971988/users/2725a0401fc04904adf55f7c72281e3a/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:09.793301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.805755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-38f3c162-16b8-4571-92e6-1afcf7f93d8b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:09.807062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38f3c162-16b8-4571-92e6-1afcf7f93d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:09.836267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:09.870233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:09.876823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0d58-cc9a-4789-bb9f-67264b7e0d9e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:09.884788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 796/1605] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:09.884788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3c162-16b8-4571-92e6-1afcf7f93d8b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.885096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:09.885930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:09.886052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:09.886308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] PATH_INFO: `/v3/projects/20d7296a14de4044bbc619c9b543fbc5/users/f73a4a7402b5436fae5480259740e0c2/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:09.904331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d7296a14de4044bbc619c9b543fbc5, user_id=f73a4a7402b5436fae5480259740e0c2, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:09.907200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:09.922930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 810/1606] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:09 2022] PUT /identity/v3/projects/20d7296a14de4044bbc619c9b543fbc5/users/f73a4a7402b5436fae5480259740e0c2/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:09.924427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:09.971756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3c162-16b8-4571-92e6-1afcf7f93d8b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.024688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d10ea-58fd-4bfc-ae12-9e4cca18b050 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.031243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.032585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.033083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.033488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] PATH_INFO: `/v3/projects/e988d9acf37a4d70a977820f2d4a87d1/users/fdb7563fdb8e4ee9927d2a0095e9c986/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.040339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.041238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.041711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.042464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.051205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e988d9acf37a4d70a977820f2d4a87d1, user_id=fdb7563fdb8e4ee9927d2a0095e9c986, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.054396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.054627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.056357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.070256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 797/1607] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:10.071256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.084386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 811/1608] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:09 2022] PUT /identity/v3/projects/e988d9acf37a4d70a977820f2d4a87d1/users/fdb7563fdb8e4ee9927d2a0095e9c986/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:10.085630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d693-8777-410e-8f6b-c9d28a83c252 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.085915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.154633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f035-63d0-4bdd-a585-86ba0871c50c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.159185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6553272-3a1d-462b-834c-3ac1a07eb2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.159974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6553272-3a1d-462b-834c-3ac1a07eb2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.160416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6553272-3a1d-462b-834c-3ac1a07eb2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.160786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6553272-3a1d-462b-834c-3ac1a07eb2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.163352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.164562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.164846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.165523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] PATH_INFO: `/v3/projects/53288d567a8f426bb068908db481e32e/users/5b5c8dedd274447da8ee4600feb6a26c/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.171919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6553272-3a1d-462b-834c-3ac1a07eb2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.173593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6553272-3a1d-462b-834c-3ac1a07eb2c7 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.183444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53288d567a8f426bb068908db481e32e, user_id=5b5c8dedd274447da8ee4600feb6a26c, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.185204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 812/1609] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:10.186869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9a85e-d0da-491d-8410-e826b15827b0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.186869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9a85e-d0da-491d-8410-e826b15827b0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.187092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.187206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9a85e-d0da-491d-8410-e826b15827b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.211331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 798/1610] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:10 2022] PUT /identity/v3/projects/53288d567a8f426bb068908db481e32e/users/5b5c8dedd274447da8ee4600feb6a26c/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:10.211609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.214278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:10.219033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c0b9a85e-d0da-491d-8410-e826b15827b0 None None] MFA Rules not processed for user `2725a0401fc04904adf55f7c72281e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:10.220462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c0b9a85e-d0da-491d-8410-e826b15827b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:10.234820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:10.326436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a450d74-5c20-4500-9ba6-f7b067a97462 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.330578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a4deb-ea19-4434-8a77-be521677f2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.330773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:10.331243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4deb-ea19-4434-8a77-be521677f2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.331527 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4deb-ea19-4434-8a77-be521677f2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.331803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4deb-ea19-4434-8a77-be521677f2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.350987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 813/1611] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:10.351454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96358d-21ed-425b-8354-12b01bb9af4c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.351851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96358d-21ed-425b-8354-12b01bb9af4c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.352164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96358d-21ed-425b-8354-12b01bb9af4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.421132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3e96358d-21ed-425b-8354-12b01bb9af4c None None] MFA Rules not processed for user `f73a4a7402b5436fae5480259740e0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:10.422844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3e96358d-21ed-425b-8354-12b01bb9af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:10.431499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a4deb-ea19-4434-8a77-be521677f2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.433552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a4deb-ea19-4434-8a77-be521677f2a4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.451573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 799/1612] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:10.453939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794cba-6c58-467b-86a3-bfb589b127d9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.454231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794cba-6c58-467b-86a3-bfb589b127d9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.454523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794cba-6c58-467b-86a3-bfb589b127d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.493847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e1794cba-6c58-467b-86a3-bfb589b127d9 None None] MFA Rules not processed for user `fdb7563fdb8e4ee9927d2a0095e9c986`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:10.495857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1794cba-6c58-467b-86a3-bfb589b127d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:10.522225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 814/1613] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:10.527948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241c7b-70fa-4f2d-81c8-728b89c7c174 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.528276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241c7b-70fa-4f2d-81c8-728b89c7c174 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.528563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241c7b-70fa-4f2d-81c8-728b89c7c174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.556144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1a241c7b-70fa-4f2d-81c8-728b89c7c174 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:10.558791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1a241c7b-70fa-4f2d-81c8-728b89c7c174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:10.577888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 815/1614] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:10.579479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a241c7b-70fa-4f2d-81c8-728b89c7c174 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.583729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 800/1615] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:10.584632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1794cba-6c58-467b-86a3-bfb589b127d9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.596365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1794cba-6c58-467b-86a3-bfb589b127d9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.602082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.602969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.603357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.603646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.604484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.606599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.608462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a241c7b-70fa-4f2d-81c8-728b89c7c174 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.625514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.626562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.626945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.627289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.628322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.630996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.641609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 801/1616] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:10.644135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.688150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 816/1617] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:10.690067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.713776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:10.779237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6bd4a-6f76-4ba0-8fe5-7a57f9e9c7ef admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.813107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f68ea-df3b-42b9-9918-c97e36058374 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.823969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.824694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.824978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.825448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.933593 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.935169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.936185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.937315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.937606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.937938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.939257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.944081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.955816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 817/1618] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:10.957015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:10.967035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:10.973090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3817d-6d41-4e72-8c39-3b590c558d62 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:10.983026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:10.983877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:10.984310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:10.984732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:10.985547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:10.988259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:10.993203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 802/1619] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/projects => generated 387 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:10.995372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.026355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 818/1620] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:11.026355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.056603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb606b6-aa91-456d-a675-badc93f463e1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.132956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceba0e1-2605-40b7-bc40-7f96650f4c3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.139457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.140379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.140825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.141120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.141880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.144054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.168584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.169742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.170187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.180870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.180870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.181461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 803/1621] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:10 2022] POST /identity/v3/users => generated 308 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:11.181461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.181657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.195541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199702e-bd0a-4a7d-9ee7-14609fba68fa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.217074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.217074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.217074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.217074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.218748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.219861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 819/1622] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:11 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:11.221556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.221895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.243172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ed41-25d6-4f1b-b17d-4dd5c077287d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.249116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 804/1623] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:11.250645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.265966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.272789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.273317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.273723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.278012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.279865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.290007 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c2812-3676-48a5-bbbe-bab8aa1f7e7d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.300600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 820/1624] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:11.302058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.304171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.305001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.305399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.305775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.307248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.325009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.356719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 805/1625] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:11.357414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.375153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96183fd-1154-4644-aacf-a8080cbb38e0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.384906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc152e-a0fa-4452-888f-40e28a60ffab admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.391428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.392389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.392750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.393024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] PATH_INFO: `/v3/projects/3bb3873f89d044a49234990b2aab4782/users/e6f0d58ff65b44cc9d834cfe08342956/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.393370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.394329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.394686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.395030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] PATH_INFO: `/v3/projects/1af73b79f5c04af58f6140e30c4242e8/users/9894bcca38b143ad97ac5b48aa6fcd73/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.425648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb3873f89d044a49234990b2aab4782, user_id=e6f0d58ff65b44cc9d834cfe08342956, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.430559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.436344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af73b79f5c04af58f6140e30c4242e8, user_id=9894bcca38b143ad97ac5b48aa6fcd73, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.439890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.459489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 821/1626] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:11 2022] PUT /identity/v3/projects/3bb3873f89d044a49234990b2aab4782/users/e6f0d58ff65b44cc9d834cfe08342956/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:11.459489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.470330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 806/1627] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:11 2022] PUT /identity/v3/projects/1af73b79f5c04af58f6140e30c4242e8/users/9894bcca38b143ad97ac5b48aa6fcd73/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:11.470330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.488135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:11.601511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f40bd0-06a7-4b37-b6e1-b60b67aa0193 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.607638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17905-c2bd-462c-b074-d8ff3ba24a8c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.612629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.613580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.613868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.614788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] PATH_INFO: `/v3/projects/8e6abbd5ae1b4e42b51cf89a20294ecd/users/a3f4620b26f44cc09f3366b4ac621b97/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.622136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.622970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.623133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.623398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.624632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.631518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.649233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6abbd5ae1b4e42b51cf89a20294ecd, user_id=a3f4620b26f44cc09f3366b4ac621b97, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.656800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.657035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 807/1628] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:11.657642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.682158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d091e2e-c7db-4f4f-adc7-6e88210a7d66 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.683170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 822/1629] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:11 2022] PUT /identity/v3/projects/8e6abbd5ae1b4e42b51cf89a20294ecd/users/a3f4620b26f44cc09f3366b4ac621b97/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:11.684582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.736786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:11.820830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.821581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.822048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.822974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.823765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.825447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.842684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa93b9-8cdc-4be9-909b-6a0c316966dd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.852169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 808/1630] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:11.853995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.856891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.858089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.858469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.859190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] PATH_INFO: `/v3/projects/3bb3873f89d044a49234990b2aab4782/users/e6f0d58ff65b44cc9d834cfe08342956/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.864048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb3873f89d044a49234990b2aab4782, user_id=e6f0d58ff65b44cc9d834cfe08342956, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.870816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.881136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c47c4-9869-43ae-9894-64b9ed86fde8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:11.896402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cfa82-4c71-4006-b321-8d11a3bfa1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:11.897472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cfa82-4c71-4006-b321-8d11a3bfa1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.897730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 823/1631] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:11 2022] PUT /identity/v3/projects/3bb3873f89d044a49234990b2aab4782/users/e6f0d58ff65b44cc9d834cfe08342956/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:11.898158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cfa82-4c71-4006-b321-8d11a3bfa1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.898601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cfa82-4c71-4006-b321-8d11a3bfa1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.899353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:11.899680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cfa82-4c71-4006-b321-8d11a3bfa1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:11.901532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cfa82-4c71-4006-b321-8d11a3bfa1eb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:11.928161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 809/1632] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:11.929910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76f05-0f7f-4064-af85-6712eb9143cf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:11.930367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76f05-0f7f-4064-af85-6712eb9143cf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:11.930788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76f05-0f7f-4064-af85-6712eb9143cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:11.988994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-91f76f05-0f7f-4064-af85-6712eb9143cf None None] MFA Rules not processed for user `e6f0d58ff65b44cc9d834cfe08342956`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:11.992141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-91f76f05-0f7f-4064-af85-6712eb9143cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:12.065943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd18a-9adb-46f6-84cb-d695608d775e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:12.074316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078bdc9-b4dc-4438-8e81-e498c8a9e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:12.075534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bdc9-b4dc-4438-8e81-e498c8a9e83a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.075979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bdc9-b4dc-4438-8e81-e498c8a9e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.076474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bdc9-b4dc-4438-8e81-e498c8a9e83a admin admin] PATH_INFO: `/v3/projects/1af73b79f5c04af58f6140e30c4242e8/users/9894bcca38b143ad97ac5b48aa6fcd73/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.084988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078bdc9-b4dc-4438-8e81-e498c8a9e83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af73b79f5c04af58f6140e30c4242e8, user_id=9894bcca38b143ad97ac5b48aa6fcd73, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:12.088147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078bdc9-b4dc-4438-8e81-e498c8a9e83a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:12.115813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 810/1633] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:12.117472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f76f05-0f7f-4064-af85-6712eb9143cf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:12.119025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 824/1634] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:11 2022] PUT /identity/v3/projects/1af73b79f5c04af58f6140e30c4242e8/users/9894bcca38b143ad97ac5b48aa6fcd73/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:12.131420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2de0d7-da52-471a-b2c6-554f642d94e2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.131736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2de0d7-da52-471a-b2c6-554f642d94e2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.131992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2de0d7-da52-471a-b2c6-554f642d94e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.141927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f76f05-0f7f-4064-af85-6712eb9143cf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:12.154740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:12.193141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-aa2de0d7-da52-471a-b2c6-554f642d94e2 None None] MFA Rules not processed for user `9894bcca38b143ad97ac5b48aa6fcd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:12.194425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aa2de0d7-da52-471a-b2c6-554f642d94e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:12.250053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:12.251368 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.252751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.253222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] PATH_INFO: `/v3/projects/8e6abbd5ae1b4e42b51cf89a20294ecd/users/a3f4620b26f44cc09f3366b4ac621b97/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.256396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6abbd5ae1b4e42b51cf89a20294ecd, user_id=a3f4620b26f44cc09f3366b4ac621b97, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:12.262329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:12.304389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 811/1635] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:12 2022] PUT /identity/v3/projects/8e6abbd5ae1b4e42b51cf89a20294ecd/users/a3f4620b26f44cc09f3366b4ac621b97/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:12.306377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:12.358432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 825/1636] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:12.360210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7e73-d7cd-46eb-b142-88012eb3d59d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.360507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7e73-d7cd-46eb-b142-88012eb3d59d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.361082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7e73-d7cd-46eb-b142-88012eb3d59d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.366501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 826/1637] 10.222.0.69 () {54 vars in 961 bytes} [Thu May 26 18:01:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:12.368597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcce16-8bbf-4140-9374-7ed954d046e2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.368895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcce16-8bbf-4140-9374-7ed954d046e2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.369179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcce16-8bbf-4140-9374-7ed954d046e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.409585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516459-ef6a-466f-a77b-31103676252e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:12.414528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:12.415207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.415561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.415850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.423132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e6dcce16-8bbf-4140-9374-7ed954d046e2 None None] MFA Rules not processed for user `a3f4620b26f44cc09f3366b4ac621b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:12.424689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e6dcce16-8bbf-4140-9374-7ed954d046e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:12.460486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:12.538043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 827/1638] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:12.540109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca3c9-f48c-4a41-83e0-e06f6477af73 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.540576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca3c9-f48c-4a41-83e0-e06f6477af73 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.541022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca3c9-f48c-4a41-83e0-e06f6477af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.571219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d9fca3c9-f48c-4a41-83e0-e06f6477af73 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:12.573633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9fca3c9-f48c-4a41-83e0-e06f6477af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:12.605730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:12.611450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:12.643022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 812/1639] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:12.646528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:12.669861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98f705-6947-48cf-b41e-6c248262de6f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:12.682162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 828/1640] 10.222.0.69 () {58 vars in 1058 bytes} [Thu May 26 18:01:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:12.687565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:12.688843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.689137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.689422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.693324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47ec1-ab93-4a06-8bd2-acf1c809e909 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.694248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47ec1-ab93-4a06-8bd2-acf1c809e909 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.694768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47ec1-ab93-4a06-8bd2-acf1c809e909 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.697186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 829/1641] 10.222.0.69 () {54 vars in 912 bytes} [Thu May 26 18:01:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:01:12.705328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a170b-c98e-4bf5-8515-66d064f18505 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.705910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a170b-c98e-4bf5-8515-66d064f18505 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.706358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a170b-c98e-4bf5-8515-66d064f18505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.752629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b77a170b-c98e-4bf5-8515-66d064f18505 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:12.760866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b77a170b-c98e-4bf5-8515-66d064f18505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:12.794312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 830/1642] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:01:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:12.795785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a170b-c98e-4bf5-8515-66d064f18505 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:12.814098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a170b-c98e-4bf5-8515-66d064f18505 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:12.826688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:12.828004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:12.828510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:12.829114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:12.840665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:12.842737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:12.856544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 831/1643] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:12.869380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:12.917124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:12.919440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:12.988045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 813/1644] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:13.060618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:13.079182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048af1ed-bd1e-4be1-a7d2-3bb16bfad29a service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:13.087964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07717625-c30b-4559-a42e-e80a6685d3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:13.089698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717625-c30b-4559-a42e-e80a6685d3ae service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:13.090325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717625-c30b-4559-a42e-e80a6685d3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:13.090810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717625-c30b-4559-a42e-e80a6685d3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:13.109088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:13.135098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07717625-c30b-4559-a42e-e80a6685d3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:13.137786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07717625-c30b-4559-a42e-e80a6685d3ae service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:13.169961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 832/1645] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:13.231636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b692b-43f1-46c4-9a8e-68090a722982 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:13.234182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b692b-43f1-46c4-9a8e-68090a722982 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:13.234601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b692b-43f1-46c4-9a8e-68090a722982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:13.314605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-271b692b-43f1-46c4-9a8e-68090a722982 None None] MFA Rules not processed for user `9caae6984c3b47c59f8b385af0b40f98`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:13.318104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-271b692b-43f1-46c4-9a8e-68090a722982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:13.335918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a38294-c77e-4ebf-bbe2-bda149e9f378 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:13.355411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:13.357745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:13.358529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:13.359442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] PATH_INFO: `/v3/users/fdb7563fdb8e4ee9927d2a0095e9c986` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:13.362568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb7563fdb8e4ee9927d2a0095e9c986)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:13.373127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:01:13.373127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 26 18:01:13.373127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: May 26 18:01:13.382827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:13.528071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 833/1646] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:13.528071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b692b-43f1-46c4-9a8e-68090a722982 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:13.568578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b692b-43f1-46c4-9a8e-68090a722982 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:13.589990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:13.591897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:13.594954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:13.596423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] PATH_INFO: `/v3/users/2725a0401fc04904adf55f7c72281e3a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:13.603273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2725a0401fc04904adf55f7c72281e3a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:13.609301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb7563fdb8e4ee9927d2a0095e9c986'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.611284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:13.628849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:13.642038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb7563fdb8e4ee9927d2a0095e9c986'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.643882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb7563fdb8e4ee9927d2a0095e9c986'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.644806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb7563fdb8e4ee9927d2a0095e9c986'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.744460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84949e26-136c-4c64-b12a-862e2cf15a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb7563fdb8e4ee9927d2a0095e9c986'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.747618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2725a0401fc04904adf55f7c72281e3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.793675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2725a0401fc04904adf55f7c72281e3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.812598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 814/1647] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:13 2022] DELETE /identity/v3/users/fdb7563fdb8e4ee9927d2a0095e9c986 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:13.812598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f48c-75fb-4bc7-baea-397a273d650f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:13.812598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f48c-75fb-4bc7-baea-397a273d650f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:13.812598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f48c-75fb-4bc7-baea-397a273d650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:13.814668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2725a0401fc04904adf55f7c72281e3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.832629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2725a0401fc04904adf55f7c72281e3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.835247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-039d38d1-8c36-4a36-8cf3-5df20cedbea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2725a0401fc04904adf55f7c72281e3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:13.852397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b4c2f48c-75fb-4bc7-baea-397a273d650f None None] MFA Rules not processed for user `9caae6984c3b47c59f8b385af0b40f98`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:13.856063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 834/1648] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:13 2022] DELETE /identity/v3/users/2725a0401fc04904adf55f7c72281e3a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:13.857208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b4c2f48c-75fb-4bc7-baea-397a273d650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:13.858812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668fcb-7ec5-4639-9819-8a858113f577 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:13.859109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668fcb-7ec5-4639-9819-8a858113f577 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:13.859408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668fcb-7ec5-4639-9819-8a858113f577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:13.937045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-34668fcb-7ec5-4639-9819-8a858113f577 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:13.938526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-34668fcb-7ec5-4639-9819-8a858113f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:13.998194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 815/1649] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:13.999732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.000142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.000537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.095211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:14.096685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.117403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 835/1650] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:14.118730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:14.121728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99a2d-35fa-4090-b4b7-ab02c6981055 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.122601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99a2d-35fa-4090-b4b7-ab02c6981055 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.123120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99a2d-35fa-4090-b4b7-ab02c6981055 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.125980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 836/1651] 10.222.0.69 () {54 vars in 961 bytes} [Thu May 26 18:01:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:14.138414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.140433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.142400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.179423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:14.181842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.229844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 816/1652] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:14.229844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:14.233326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.249533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a75905-7f9b-4dae-ac54-9768318f785f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:14.255717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:14.256821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.257211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.257593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] PATH_INFO: `/v3/users/f73a4a7402b5436fae5480259740e0c2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.259402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73a4a7402b5436fae5480259740e0c2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:14.262704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:14.309866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 837/1653] 10.222.0.69 () {58 vars in 1058 bytes} [Thu May 26 18:01:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:14.310876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:14.312342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.336217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:14.349772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73a4a7402b5436fae5480259740e0c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:14.366236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73a4a7402b5436fae5480259740e0c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:14.367023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73a4a7402b5436fae5480259740e0c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:14.367750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73a4a7402b5436fae5480259740e0c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:14.386704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73a4a7402b5436fae5480259740e0c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:14.395359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c523a6-43e3-47c1-906a-265f0109daae None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:14.403490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:14.404354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.404771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.405164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.407542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.410764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 817/1654] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:14 2022] DELETE /identity/v3/users/f73a4a7402b5436fae5480259740e0c2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:14.412828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:14.414882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.421829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:14.424826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:14.444365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 838/1655] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:14.445596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:14.447130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.470464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a804f-8846-42d8-86fe-5dacf9f957f3 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:14.492721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd83dcc-7270-422f-9f79-08a1efe967e7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:14.498110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24e18a-da48-4750-bb23-ca18c201c8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:14.499101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e18a-da48-4750-bb23-ca18c201c8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.499454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e18a-da48-4750-bb23-ca18c201c8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.499866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e18a-da48-4750-bb23-ca18c201c8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.501909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1a24e18a-da48-4750-bb23-ca18c201c8c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.579886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d462cf0-a79a-4051-9960-bf163a58f01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:14.580737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462cf0-a79a-4051-9960-bf163a58f01d service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.581061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462cf0-a79a-4051-9960-bf163a58f01d service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.581379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462cf0-a79a-4051-9960-bf163a58f01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.586282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d462cf0-a79a-4051-9960-bf163a58f01d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.682826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d462cf0-a79a-4051-9960-bf163a58f01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:14.685125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d462cf0-a79a-4051-9960-bf163a58f01d service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:14.700734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 839/1656] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:14.702368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8852-60a2-4262-ad4c-1c4c37ef9fa3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.702750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8852-60a2-4262-ad4c-1c4c37ef9fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.703113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8852-60a2-4262-ad4c-1c4c37ef9fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.727023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3cbf8852-60a2-4262-ad4c-1c4c37ef9fa3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:14.728454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3cbf8852-60a2-4262-ad4c-1c4c37ef9fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:14.798019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:14.821855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 840/1657] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:14.828572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:14.864478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf8852-60a2-4262-ad4c-1c4c37ef9fa3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:14.878215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf8852-60a2-4262-ad4c-1c4c37ef9fa3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:14.887488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6a870-a449-4f18-a8e5-fde713bda7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:14.890366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6a870-a449-4f18-a8e5-fde713bda7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:14.890656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6a870-a449-4f18-a8e5-fde713bda7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:14.892244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6a870-a449-4f18-a8e5-fde713bda7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:14.899464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24e18a-da48-4750-bb23-ca18c201c8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:14.904225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24e18a-da48-4750-bb23-ca18c201c8c9 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:14.917894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6a870-a449-4f18-a8e5-fde713bda7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:14.920162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6a870-a449-4f18-a8e5-fde713bda7b4 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:14.948511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 841/1658] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:01:14.956443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 818/1659] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:15.411845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a362f4-5e94-479d-bde5-afd01981159c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:15.412433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a362f4-5e94-479d-bde5-afd01981159c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:15.413019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a362f4-5e94-479d-bde5-afd01981159c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:15.414978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 842/1660] 10.222.0.69 () {54 vars in 912 bytes} [Thu May 26 18:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:15.443156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:15.443669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:15.444124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:15.481949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:15.483346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:15.503312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 819/1661] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:01:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:15.526831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a362f4-5e94-479d-bde5-afd01981159c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:15.529382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f9a362f4-5e94-479d-bde5-afd01981159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:15.701980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a362f4-5e94-479d-bde5-afd01981159c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:15.711879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364a45d-2913-4488-a805-43b1458f2a5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:15.712589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364a45d-2913-4488-a805-43b1458f2a5e service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:15.712878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364a45d-2913-4488-a805-43b1458f2a5e service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:15.713160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364a45d-2913-4488-a805-43b1458f2a5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:15.740242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364a45d-2913-4488-a805-43b1458f2a5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:15.743601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364a45d-2913-4488-a805-43b1458f2a5e service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:15.775718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 843/1662] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:16.291234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:16.293590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:16.335331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5427-7a74-4bff-8c84-8350fa88349d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:16.354695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:16.356892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:16.359221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:16.359221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] PATH_INFO: `/v3/projects/e988d9acf37a4d70a977820f2d4a87d1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:16.361720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e988d9acf37a4d70a977820f2d4a87d1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:16.365906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:16.372287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33f066-69a1-4a5c-b812-be626796f627 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:16.372753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33f066-69a1-4a5c-b812-be626796f627 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:16.373105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33f066-69a1-4a5c-b812-be626796f627 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:16.374705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 844/1663] 10.222.0.69 () {54 vars in 912 bytes} [Thu May 26 18:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:01:16.383971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:16.383971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:16.383971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:16.497531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] MFA Rules not processed for user `eadb39271321475ebb10382db43db0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:16.499023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:16.523422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e988d9acf37a4d70a977820f2d4a87d1', 'request_id': 'req-46cb437d-962b-406c-9a9b-430c17fc8099'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.544881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e988d9acf37a4d70a977820f2d4a87d1', 'request_id': 'req-46cb437d-962b-406c-9a9b-430c17fc8099'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.566907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e988d9acf37a4d70a977820f2d4a87d1', 'request_id': 'req-46cb437d-962b-406c-9a9b-430c17fc8099'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.605831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] The token cache is being invalidate because project e988d9acf37a4d70a977820f2d4a87d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:16.606506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.608221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.618305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 820/1664] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:16 2022] DELETE /identity/v3/projects/e988d9acf37a4d70a977820f2d4a87d1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:16.619241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:16.621411 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:16.667282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 845/1665] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:01:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:16.704541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:16.707880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:16.736185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1469d0-9a97-492b-b3dc-90b5b71bd2fc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:16.750490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:16.751332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:16.751620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:16.751943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:16.762050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb437d-962b-406c-9a9b-430c17fc8099 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:16.784860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:16.786659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:16.787221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:16.789203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:16.789885 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] PATH_INFO: `/v3/users/a3f4620b26f44cc09f3366b4ac621b97` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:16.790718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:16.791721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f4620b26f44cc09f3366b4ac621b97)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:16.793901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:16.825145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 846/1666] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:16.954337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f4620b26f44cc09f3366b4ac621b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.966498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f4620b26f44cc09f3366b4ac621b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.967477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f4620b26f44cc09f3366b4ac621b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.969287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f4620b26f44cc09f3366b4ac621b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:16.976422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:17.008625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f4620b26f44cc09f3366b4ac621b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.044497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 821/1667] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:16 2022] DELETE /identity/v3/users/a3f4620b26f44cc09f3366b4ac621b97 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:17.201630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:17.203233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:17.239846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6351478-9c88-41c9-8012-c05a25f68c4a service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:17.474298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:17.477308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:17.477603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:17.477976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] PATH_INFO: `/v3/projects/20d7296a14de4044bbc619c9b543fbc5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:17.485913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d7296a14de4044bbc619c9b543fbc5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:17.490990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:01:17.490990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 26 18:01:17.490990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: May 26 18:01:17.492854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:17.525744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:17.539964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:17.542274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:17.577417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda4a4d-26e6-43d9-a566-d91116860975 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:17.603314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:17.604232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:17.604559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:17.604865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] PATH_INFO: `/v3/projects/421956e14b9e4148995a4dde9c971988` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:17.606582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] RBAC: Authorizing `identity:delete_project(project_id=421956e14b9e4148995a4dde9c971988)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:17.608572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:17.635687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d7296a14de4044bbc619c9b543fbc5', 'request_id': 'req-a5670161-906f-4957-9abc-d976ab715919'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.658022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d7296a14de4044bbc619c9b543fbc5', 'request_id': 'req-a5670161-906f-4957-9abc-d976ab715919'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.672404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d7296a14de4044bbc619c9b543fbc5', 'request_id': 'req-a5670161-906f-4957-9abc-d976ab715919'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.707064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] The token cache is being invalidate because project 20d7296a14de4044bbc619c9b543fbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:17.710668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.714533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.721459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 847/1668] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:17 2022] DELETE /identity/v3/projects/20d7296a14de4044bbc619c9b543fbc5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:17.722895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:17.730654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:17.775405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421956e14b9e4148995a4dde9c971988', 'request_id': 'req-580b5c93-a82c-4374-b657-b615ed96adba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.791863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421956e14b9e4148995a4dde9c971988', 'request_id': 'req-580b5c93-a82c-4374-b657-b615ed96adba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.816749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421956e14b9e4148995a4dde9c971988', 'request_id': 'req-580b5c93-a82c-4374-b657-b615ed96adba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.857762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] The token cache is being invalidate because project 421956e14b9e4148995a4dde9c971988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:17.858065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.859764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:17.870103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 822/1669] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:17 2022] DELETE /identity/v3/projects/421956e14b9e4148995a4dde9c971988 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:17.871139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:17.874930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:17.938330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5670161-906f-4957-9abc-d976ab715919 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:18.106062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5c93-a82c-4374-b657-b615ed96adba admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:18.127221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:18.128232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:18.128524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:18.128803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] PATH_INFO: `/v3/users/9894bcca38b143ad97ac5b48aa6fcd73` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:18.130651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9894bcca38b143ad97ac5b48aa6fcd73)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:18.132687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:18.163587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:18.164847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:18.165269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:18.165681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] PATH_INFO: `/v3/users/e6f0d58ff65b44cc9d834cfe08342956` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:18.168274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f0d58ff65b44cc9d834cfe08342956)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:18.173640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:18.279551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9894bcca38b143ad97ac5b48aa6fcd73'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.318465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9894bcca38b143ad97ac5b48aa6fcd73'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.321912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9894bcca38b143ad97ac5b48aa6fcd73'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.322625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9894bcca38b143ad97ac5b48aa6fcd73'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.335671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:18.364199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f0d58ff65b44cc9d834cfe08342956'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.365459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9894bcca38b143ad97ac5b48aa6fcd73'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.365795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:18.412416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 823/1670] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:17 2022] DELETE /identity/v3/users/9894bcca38b143ad97ac5b48aa6fcd73 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:18.435749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f0d58ff65b44cc9d834cfe08342956'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.458742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f0d58ff65b44cc9d834cfe08342956'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.500407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f0d58ff65b44cc9d834cfe08342956'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.501239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9998b18e-e965-453e-bb15-883d0155f8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f0d58ff65b44cc9d834cfe08342956'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.515817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 848/1671] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:17 2022] DELETE /identity/v3/users/e6f0d58ff65b44cc9d834cfe08342956 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:18.521334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:18.523089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:18.723705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496829a1-0b7d-4e14-bc2f-770f0a00152f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:18.877724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:18.878816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:18.880055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:18.880455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] PATH_INFO: `/v3/projects/8e6abbd5ae1b4e42b51cf89a20294ecd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:18.882298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6abbd5ae1b4e42b51cf89a20294ecd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:18.885518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:18.984937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6abbd5ae1b4e42b51cf89a20294ecd', 'request_id': 'req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:18.998670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6abbd5ae1b4e42b51cf89a20294ecd', 'request_id': 'req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:19.015102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6abbd5ae1b4e42b51cf89a20294ecd', 'request_id': 'req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:19.046660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] The token cache is being invalidate because project 8e6abbd5ae1b4e42b51cf89a20294ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:19.047075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:19.050060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5bc7ddd2-3306-4cef-bd9e-c43637c5ef50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:19.059024 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 824/1672] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:18 2022] DELETE /identity/v3/projects/8e6abbd5ae1b4e42b51cf89a20294ecd => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:19.069597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff449d-bebc-4e17-b21b-ebaaec04f5a7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.070319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff449d-bebc-4e17-b21b-ebaaec04f5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.070792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff449d-bebc-4e17-b21b-ebaaec04f5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.145573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e7ff449d-bebc-4e17-b21b-ebaaec04f5a7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:19.148620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e7ff449d-bebc-4e17-b21b-ebaaec04f5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:19.365072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 849/1673] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:19.376301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f2cd8-55e3-439d-a980-f07e2363367e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.376642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f2cd8-55e3-439d-a980-f07e2363367e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.376880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f2cd8-55e3-439d-a980-f07e2363367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.417806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c72f2cd8-55e3-439d-a980-f07e2363367e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:19.419708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c72f2cd8-55e3-439d-a980-f07e2363367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:19.437301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff449d-bebc-4e17-b21b-ebaaec04f5a7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:19.454701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 825/1674] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:19.462875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff449d-bebc-4e17-b21b-ebaaec04f5a7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:19.472171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:19.472940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.473434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.473763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.475090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:19.475452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:19.478324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:19.498646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 850/1675] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:19.503577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f2cd8-55e3-439d-a980-f07e2363367e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:19.516960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f2cd8-55e3-439d-a980-f07e2363367e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:19.531821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03deb5-3812-4aa9-8168-80dd42d32011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:19.538884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03deb5-3812-4aa9-8168-80dd42d32011 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.539296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03deb5-3812-4aa9-8168-80dd42d32011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.539584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03deb5-3812-4aa9-8168-80dd42d32011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.540447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03deb5-3812-4aa9-8168-80dd42d32011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:19.542435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03deb5-3812-4aa9-8168-80dd42d32011 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:19.558905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:19.628952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 826/1676] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:19 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:19.634120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:19.649581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee2d12-301e-49c6-9a19-fb2663894909 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:19.662052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d4b9-04d5-420d-a5cd-8901f87fd9fa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.662269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d4b9-04d5-420d-a5cd-8901f87fd9fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.662552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d4b9-04d5-420d-a5cd-8901f87fd9fa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.664311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 827/1677] 10.222.0.69 () {54 vars in 960 bytes} [Thu May 26 18:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:19.695344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6df2f-7659-4bef-9c89-b1c93534c1ed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.695850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6df2f-7659-4bef-9c89-b1c93534c1ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.696006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6df2f-7659-4bef-9c89-b1c93534c1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.740926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a1d6df2f-7659-4bef-9c89-b1c93534c1ed None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:19.742506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1d6df2f-7659-4bef-9c89-b1c93534c1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:19.920738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:19.923073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.925761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.927038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.934244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:19.935640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 828/1678] 10.222.0.69 () {58 vars in 1057 bytes} [Thu May 26 18:01:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:19.945751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6df2f-7659-4bef-9c89-b1c93534c1ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:19.952199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:19.967114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6df2f-7659-4bef-9c89-b1c93534c1ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:19.974816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:19.975862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:19.976421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:19.978081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:19.981784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:20.012633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:20.018083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:20.032644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 851/1679] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:19 2022] POST /identity/v3/users => generated 291 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:20.037485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:20.059850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 829/1680] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:20.070017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b963-1b32-4f16-990b-0591c942e73d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:20.088007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:20.088746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:20.090802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:20.090802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:20.091574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:20.093287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:20.121426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 852/1681] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:20.127326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:20.143526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd917-e330-4db8-bf10-fdf249b83bdc service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:20.152988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47e24c-9307-4441-be04-867d7e17eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:20.155490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47e24c-9307-4441-be04-867d7e17eeca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:20.155899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47e24c-9307-4441-be04-867d7e17eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:20.156294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47e24c-9307-4441-be04-867d7e17eeca admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:20.157219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47e24c-9307-4441-be04-867d7e17eeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:20.159967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47e24c-9307-4441-be04-867d7e17eeca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:20.176504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 830/1682] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:20.181308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:20.192416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4a4ef-828f-4099-a69e-b290c60e924f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:20.203600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:20.204568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:20.204937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:20.205296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] PATH_INFO: `/v3/projects/e9a25badbbdc47739c49410e0bd3e531/users/ce32de3f367b44b385704269c4af5bf0/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:20.228070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a25badbbdc47739c49410e0bd3e531, user_id=ce32de3f367b44b385704269c4af5bf0, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:20.230966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:20.255356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 853/1683] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:20 2022] PUT /identity/v3/projects/e9a25badbbdc47739c49410e0bd3e531/users/ce32de3f367b44b385704269c4af5bf0/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:20.268165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6e05b-a609-46aa-a5ac-d227f7bfef58 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:20.268500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6e05b-a609-46aa-a5ac-d227f7bfef58 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:20.268750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6e05b-a609-46aa-a5ac-d227f7bfef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:20.344949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5be6e05b-a609-46aa-a5ac-d227f7bfef58 None None] MFA Rules not processed for user `ce32de3f367b44b385704269c4af5bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:20.346151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5be6e05b-a609-46aa-a5ac-d227f7bfef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:20.547877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:20.549687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 831/1684] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:20.549829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:20.555204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6e05b-a609-46aa-a5ac-d227f7bfef58 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:20.570848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:20.735076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bcc50-44c0-4be1-a82f-0dabc92addfc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:20.752520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:20.753520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:20.753816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:20.754106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] PATH_INFO: `/v3/projects/3bb3873f89d044a49234990b2aab4782` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:20.756568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb3873f89d044a49234990b2aab4782)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:20.764836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:20.776536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:20.819520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6e05b-a609-46aa-a5ac-d227f7bfef58 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:20.825359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:20.826061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:20.826352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:20.826636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:20.827357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:20.829517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:20.882215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 832/1685] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:20 2022] POST /identity/v3/projects => generated 381 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:01:20.883614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:20.890240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:20.901866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb3873f89d044a49234990b2aab4782', 'request_id': 'req-57c7bd54-13c6-4456-9158-cddfc6ca992b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:20.932194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb3873f89d044a49234990b2aab4782', 'request_id': 'req-57c7bd54-13c6-4456-9158-cddfc6ca992b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:20.967163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb3873f89d044a49234990b2aab4782', 'request_id': 'req-57c7bd54-13c6-4456-9158-cddfc6ca992b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.000604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] The token cache is being invalidate because project 3bb3873f89d044a49234990b2aab4782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:21.001098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.003069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.010079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 854/1686] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:20 2022] DELETE /identity/v3/projects/3bb3873f89d044a49234990b2aab4782 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:21.011229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:21.021086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:21.163970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8964513-ec3c-4256-a74c-88aa3c1164e8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:21.175485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:21.180125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.180624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.181976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] PATH_INFO: `/v3/projects/1af73b79f5c04af58f6140e30c4242e8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.184602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af73b79f5c04af58f6140e30c4242e8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:21.203835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:21.210897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7bd54-13c6-4456-9158-cddfc6ca992b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:21.251355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27182b-ff9c-48e5-84de-809ee4230f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:21.253888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27182b-ff9c-48e5-84de-809ee4230f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.259115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27182b-ff9c-48e5-84de-809ee4230f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.259513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27182b-ff9c-48e5-84de-809ee4230f80 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.268687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27182b-ff9c-48e5-84de-809ee4230f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:21.268687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27182b-ff9c-48e5-84de-809ee4230f80 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:21.339039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af73b79f5c04af58f6140e30c4242e8', 'request_id': 'req-d7043e7e-7326-4611-89d7-27a40985e8b3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.340653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 855/1687] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:21 2022] POST /identity/v3/users => generated 297 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:21.342282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3348-80db-4465-bfd0-5ac08039d8cc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.342581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3348-80db-4465-bfd0-5ac08039d8cc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.342864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3348-80db-4465-bfd0-5ac08039d8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.356128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af73b79f5c04af58f6140e30c4242e8', 'request_id': 'req-d7043e7e-7326-4611-89d7-27a40985e8b3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.365517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af73b79f5c04af58f6140e30c4242e8', 'request_id': 'req-d7043e7e-7326-4611-89d7-27a40985e8b3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.381798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] The token cache is being invalidate because project 1af73b79f5c04af58f6140e30c4242e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:21.382227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.383519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:21.385854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 833/1688] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:20 2022] DELETE /identity/v3/projects/1af73b79f5c04af58f6140e30c4242e8 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:21.387107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:21.391148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-509d3348-80db-4465-bfd0-5ac08039d8cc None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:21.391506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:21.397571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-509d3348-80db-4465-bfd0-5ac08039d8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:21.447185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:21.527194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043e7e-7326-4611-89d7-27a40985e8b3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:21.535831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb99b0-5bc4-48ab-9b48-b5681364fcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:21.537553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb99b0-5bc4-48ab-9b48-b5681364fcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.537952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb99b0-5bc4-48ab-9b48-b5681364fcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.538767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb99b0-5bc4-48ab-9b48-b5681364fcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.539634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb99b0-5bc4-48ab-9b48-b5681364fcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:21.542120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb99b0-5bc4-48ab-9b48-b5681364fcc0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:21.545975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:21.561473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 856/1689] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:21.565441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8009-6b68-431d-b03d-f79b3c636a62 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.565737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8009-6b68-431d-b03d-f79b3c636a62 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.566020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8009-6b68-431d-b03d-f79b3c636a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.578352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 834/1690] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:21.579886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbbd07-9daa-4419-a965-0ca3d58d0f4d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.580212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbbd07-9daa-4419-a965-0ca3d58d0f4d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.580503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbbd07-9daa-4419-a965-0ca3d58d0f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.621364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6c4c8009-6b68-431d-b03d-f79b3c636a62 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:21.622910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6c4c8009-6b68-431d-b03d-f79b3c636a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:21.650822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 857/1691] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:21.651828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5ac54-ef50-40f2-8f61-5beef8d5c603 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.652162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5ac54-ef50-40f2-8f61-5beef8d5c603 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.652452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5ac54-ef50-40f2-8f61-5beef8d5c603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.659010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-19dbbd07-9daa-4419-a965-0ca3d58d0f4d None None] MFA Rules not processed for user `a7cc6fcd7b4c4cee8d21e2692757aaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:21.663474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-19dbbd07-9daa-4419-a965-0ca3d58d0f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:21.681955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dda5ac54-ef50-40f2-8f61-5beef8d5c603 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:21.688061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dda5ac54-ef50-40f2-8f61-5beef8d5c603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:21.712613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 858/1692] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:21.713890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5ac54-ef50-40f2-8f61-5beef8d5c603 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:21.742832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5ac54-ef50-40f2-8f61-5beef8d5c603 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:21.764960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2ed20-25c7-42f2-a14c-355cfb3c70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:21.765935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2ed20-25c7-42f2-a14c-355cfb3c70db admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.766227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2ed20-25c7-42f2-a14c-355cfb3c70db admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.766507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2ed20-25c7-42f2-a14c-355cfb3c70db admin admin] PATH_INFO: `/v3/projects/a004268525cc430dbf4425ff543bea32/users/4437c74a3be5435b97b3f561fa281dcb/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.806217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2ed20-25c7-42f2-a14c-355cfb3c70db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a004268525cc430dbf4425ff543bea32, user_id=4437c74a3be5435b97b3f561fa281dcb, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:21.810109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2ed20-25c7-42f2-a14c-355cfb3c70db admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:21.843581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 859/1693] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:21 2022] PUT /identity/v3/projects/a004268525cc430dbf4425ff543bea32/users/4437c74a3be5435b97b3f561fa281dcb/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:21.846937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed888-7ede-4338-b357-fdf982904202 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:21.847253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed888-7ede-4338-b357-fdf982904202 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:21.847506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed888-7ede-4338-b357-fdf982904202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:21.890387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 835/1694] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:21.892558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbbd07-9daa-4419-a965-0ca3d58d0f4d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:21.894115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1dfed888-7ede-4338-b357-fdf982904202 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:21.896087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1dfed888-7ede-4338-b357-fdf982904202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:21.923979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbbd07-9daa-4419-a965-0ca3d58d0f4d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:22.034684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 860/1695] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:22.035794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfed888-7ede-4338-b357-fdf982904202 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:22.059336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfed888-7ede-4338-b357-fdf982904202 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:22.073752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:22.074465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.074695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.074957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.075788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:22.081716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:22.102947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:22.104428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.104861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.106031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.106325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 861/1696] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:22.107724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:22.109117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:22.109590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:22.114679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:22.117424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:22.137353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 836/1697] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:22.139727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:22.152337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0768fe-b78f-426b-8c8e-770b09148c22 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:22.167333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:22.168357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.168789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.169213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.170110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:22.172608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:22.174475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:22.206538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 837/1698] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:22.207856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:22.236264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407df5b-ed0b-4c20-8edf-79b5fa754614 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:22.249977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:22.250902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.251195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.251479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] PATH_INFO: `/v3/projects/a004268525cc430dbf4425ff543bea32/users/4437c74a3be5435b97b3f561fa281dcb/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.253850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a004268525cc430dbf4425ff543bea32, user_id=4437c74a3be5435b97b3f561fa281dcb, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:22.257733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:22.284274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 838/1699] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:22 2022] PUT /identity/v3/projects/a004268525cc430dbf4425ff543bea32/users/4437c74a3be5435b97b3f561fa281dcb/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:22.285083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:22.438721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefbd7-a451-4d5f-84ac-dd7833758961 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:22.481262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:22.499050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e15c-aff6-4b68-a451-ae02f3ca1d20 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:22.503424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:22.527421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:22.529213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.534131 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.536436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.537408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:22.544608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:22.634430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 839/1700] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:22 2022] POST /identity/v3/projects => generated 387 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:22.637473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:22.700979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b5ca5-9d07-464e-a7ae-9054960bb3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:22.701660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5ca5-9d07-464e-a7ae-9054960bb3dc service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.701949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5ca5-9d07-464e-a7ae-9054960bb3dc service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.702233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5ca5-9d07-464e-a7ae-9054960bb3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.866293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95404c-2610-4265-b8e0-fa4d00ecc8a1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:22.875667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b5ca5-9d07-464e-a7ae-9054960bb3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:22.877354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b5ca5-9d07-464e-a7ae-9054960bb3dc service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:22.878592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:22.880783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.881266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.881651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.883836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:22.891244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:22.902459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 862/1701] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:22.903663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8193-d810-4e2b-9f77-b5de968c0774 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:22.903961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8193-d810-4e2b-9f77-b5de968c0774 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:22.909008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8193-d810-4e2b-9f77-b5de968c0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:22.962687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 840/1702] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:22 2022] POST /identity/v3/projects => generated 399 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:22.970784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:22.981629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b25b8193-d810-4e2b-9f77-b5de968c0774 None None] MFA Rules not processed for user `4437c74a3be5435b97b3f561fa281dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:22.982882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b25b8193-d810-4e2b-9f77-b5de968c0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:23.074071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28136332-205b-4639-b394-ffb0bf7c4fb0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.091153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.097378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.098936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.099578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.101245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.104806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.134501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 841/1703] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:22 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:23.135632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.149621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36d88-184e-4e35-9c67-5015564e27d4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.158036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 863/1704] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:23.158204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8193-d810-4e2b-9f77-b5de968c0774 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.159605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.161346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.161812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.162256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.163088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.166160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.192242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8193-d810-4e2b-9f77-b5de968c0774 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.212507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.213134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.213423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.213700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.214445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.216280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.221753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 842/1705] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:23 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:23.223514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.225457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:23.262743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 864/1706] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:23.263638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.296227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf476b-01c5-48ad-8516-a91be416763d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.302733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:23.320874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.321567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.321850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.322129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.322875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.325187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.357104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 865/1707] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:23.357988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.365965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff09665-e3c6-48bf-acac-56a59affe18f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.378227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.378924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.379740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.380064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.386388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415ee1-a92a-440d-befc-15f49ef1668b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.418577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.419933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.425605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.426908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.427196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.427476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.428248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.429880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.448375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 843/1708] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:23.449384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.468487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 866/1709] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:23.469425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.477536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45ca7-97cc-4a54-9045-c932d3ad9dd6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.498298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.499055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.499266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.499568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.500552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.501949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.502837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1480e-506d-47b3-8cd7-23357f1b4d1d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.521965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.522882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.523170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.523466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] PATH_INFO: `/v3/projects/65694251c84b4abe8f5b5f24c59832a1/users/0a6b6870943141ee9e9d8290a49bd06b/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.546502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:23.549451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 844/1710] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:23.554685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.567657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65694251c84b4abe8f5b5f24c59832a1, user_id=0a6b6870943141ee9e9d8290a49bd06b, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.572432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.586361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4d6b-3855-48d6-ac7d-9fc8d00a641f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.615441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 867/1711] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:23 2022] PUT /identity/v3/projects/65694251c84b4abe8f5b5f24c59832a1/users/0a6b6870943141ee9e9d8290a49bd06b/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:23.617108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:23.624434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:23.796988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb829e8-e5f5-4754-bfbe-50e0b0fa4d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.799066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb829e8-e5f5-4754-bfbe-50e0b0fa4d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.799356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb829e8-e5f5-4754-bfbe-50e0b0fa4d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.799642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb829e8-e5f5-4754-bfbe-50e0b0fa4d55 admin admin] PATH_INFO: `/v3/projects/557338c937664207b42f14a48217f194/users/c810ed954b344a6391ad2ac4a4b31a48/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.813360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a51ab-053a-4c48-b1f0-56b197c8c778 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:23.825643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:23.826560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.826851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.827134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] PATH_INFO: `/v3/users/e7cabc3c48a34cad98b2b0a7886fc36b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.832063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cabc3c48a34cad98b2b0a7886fc36b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.835176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.837695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb829e8-e5f5-4754-bfbe-50e0b0fa4d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557338c937664207b42f14a48217f194, user_id=c810ed954b344a6391ad2ac4a4b31a48, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:23.841272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb829e8-e5f5-4754-bfbe-50e0b0fa4d55 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:23.880240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 845/1712] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:23 2022] PUT /identity/v3/projects/557338c937664207b42f14a48217f194/users/c810ed954b344a6391ad2ac4a4b31a48/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:23.881798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5ab63-ba15-4212-b4d0-24f77f12efeb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:23.882100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5ab63-ba15-4212-b4d0-24f77f12efeb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:23.882387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5ab63-ba15-4212-b4d0-24f77f12efeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:23.935086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cabc3c48a34cad98b2b0a7886fc36b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:23.959303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6fa5ab63-ba15-4212-b4d0-24f77f12efeb None None] MFA Rules not processed for user `0a6b6870943141ee9e9d8290a49bd06b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:23.965764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6fa5ab63-ba15-4212-b4d0-24f77f12efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:23.972466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cabc3c48a34cad98b2b0a7886fc36b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:23.989927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cabc3c48a34cad98b2b0a7886fc36b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:24.008218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cabc3c48a34cad98b2b0a7886fc36b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:24.013766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-73779010-61ac-498a-8b1d-82b5edc5a475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cabc3c48a34cad98b2b0a7886fc36b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:24.034863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 868/1713] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:23 2022] DELETE /identity/v3/users/e7cabc3c48a34cad98b2b0a7886fc36b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:24.037497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bb65-d39f-4578-a771-32d9d8af70fb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:24.037712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bb65-d39f-4578-a771-32d9d8af70fb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:24.038066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bb65-d39f-4578-a771-32d9d8af70fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:24.107585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2048bb65-d39f-4578-a771-32d9d8af70fb None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:24.112996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2048bb65-d39f-4578-a771-32d9d8af70fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.140281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 846/1714] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:24.145893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:24.146220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:24.146510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:24.227942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] MFA Rules not processed for user `c810ed954b344a6391ad2ac4a4b31a48`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:24.230332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.266934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 869/1715] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:24.268051 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:24.268415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:24.268699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:24.307873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:24.326139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:24.327279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.335509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:24.417588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 847/1716] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:24.417588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:24.419673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.481976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 870/1717] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:24.482850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:24.485191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.569380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3acd32-358e-4fac-85ca-b26bf6e66479 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:24.575539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:24.576342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:24.576698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:24.577045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:24.577817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:24.579820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:24.613870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e6147-5172-46d5-81dc-24e16f18af55 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:24.622215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4437c74a3be5435b97b3f561fa281dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a004268525cc430dbf4425ff543bea32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:24.623915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:24.624661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:24.625058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:24.625845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:24.626747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:24.630713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:24.652984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 848/1718] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:24 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:24.656071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 871/1719] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:24.661522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:24.669469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:24.669667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.671871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.867167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9a8e1-d76f-44bc-93c1-8bf4b842b420 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:24.879647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:24.881342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f1db3-a372-4d11-8893-c3a361a35346 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:24.881951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:24.882236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:24.882514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:24.885030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:24.887433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:24.950758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 849/1720] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:24 2022] POST /identity/v3/projects => generated 399 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:24.953800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:24.959521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:24.994702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:25.038740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:25.039702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:25.039702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:25.041802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:25.042345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:25.074637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c694d-60e9-4081-8b84-5db4f237d8d7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:25.081279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:25.082141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:25.082427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:25.082816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:25.135599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:25.137393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:25.159667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 872/1721] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:01:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:01:25.162975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:25.193969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e69052-87df-47b0-9a0a-13ae57d4c273 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:25.291633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:25.295988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:25.341779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 850/1722] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:25.346952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:25.472349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:25.477522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:25.477844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:25.481676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:25.482482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:25.497321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:25.593629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 873/1723] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:25 2022] POST /identity/v3/users => generated 299 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:25.594932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:25.637320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb951-a136-4ac2-a2cd-f3b66a462e81 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:25.673918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:25.683516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:25.686011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:25.686238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:25.689728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:25.700526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:25.725105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19237be-af77-4b33-8555-a598d5a386f5 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:25.770210 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4437c74a3be5435b97b3f561fa281dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a004268525cc430dbf4425ff543bea32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:25.775461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:25.776589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:25.778613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:25.787160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:25.800547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:25.810869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 874/1724] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:25 2022] POST /identity/v3/users => generated 306 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:25.814323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:25.873209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84441b16-6e95-46d1-b05d-95b737ac1afe admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:25.879693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:25.881801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:25.882065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:25.882350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:25.883127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:25.893126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:25.930414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 851/1725] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:25 2022] POST /identity/v3/projects => generated 353 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:25.946019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 875/1726] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:25.946363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:25.952538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:25.996287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7852a0-e8e5-4654-ae1a-5c7d8c1e6959 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:26.181488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:26.213920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:26.214610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:26.214901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:26.215177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:26.216055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:26.217583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:26.270153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e3a8-8b2f-4d12-874c-8dea9099fb98 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:26.271523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 876/1727] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:26.275540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:26.293452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4437c74a3be5435b97b3f561fa281dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a004268525cc430dbf4425ff543bea32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:26.295555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:26.299446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27c81-f688-44b9-8ae3-be52afe514d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:26.300617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:26.301051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:26.303614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:26.303957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:26.309283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:26.310677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:26.311572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:26.311854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:26.312163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] PATH_INFO: `/v3/projects/adc196065f724435922a485a46984e59/users/349daa97405a46e194415ae2dc9c0edb/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:26.350784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc196065f724435922a485a46984e59, user_id=349daa97405a46e194415ae2dc9c0edb, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:26.355592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 852/1728] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:26.357893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:26.358010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:26.388658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 877/1729] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:26 2022] PUT /identity/v3/projects/adc196065f724435922a485a46984e59/users/349daa97405a46e194415ae2dc9c0edb/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:26.393091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:26.399238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24331b-afd3-46bb-abc2-f1d65152c71c tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:26.431164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:26.542597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096244a4-386b-4177-a191-16ef24344b2c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:26.549273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:26.550164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:26.550612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:26.552355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:26.553305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:26.555734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:26.578539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 878/1730] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:01:26.580125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:26.588479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:26.589415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:26.589710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:26.592618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] PATH_INFO: `/v3/projects/ca1bda5bc2184e4aa47fe2981e768914/users/225ce841ce7349fbaad135861f2496a1/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:26.631612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1bda5bc2184e4aa47fe2981e768914, user_id=225ce841ce7349fbaad135861f2496a1, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:26.636656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:26.661265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 853/1731] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:26 2022] PUT /identity/v3/projects/ca1bda5bc2184e4aa47fe2981e768914/users/225ce841ce7349fbaad135861f2496a1/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:26.662360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:26.762574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc482-9379-4243-966b-e6d113f5bda7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:26.778477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64fec-7cf7-43c1-9feb-9179bd86c9e6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:26.793269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:26.794529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:26.794664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:26.794958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] PATH_INFO: `/v3/projects/adc196065f724435922a485a46984e59/users/349daa97405a46e194415ae2dc9c0edb/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:26.797403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc196065f724435922a485a46984e59, user_id=349daa97405a46e194415ae2dc9c0edb, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:26.803687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:26.833077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 854/1732] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:26 2022] PUT /identity/v3/projects/adc196065f724435922a485a46984e59/users/349daa97405a46e194415ae2dc9c0edb/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:26.834320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:26.904567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4437c74a3be5435b97b3f561fa281dcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a004268525cc430dbf4425ff543bea32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:26.906040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:26.907907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:26.909344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] PATH_INFO: `/v3/projects/a701d9b7d7d84d238d9fdf9c7266497c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:26.911832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a701d9b7d7d84d238d9fdf9c7266497c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:26.915580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:26.919188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:27.011550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18717826-4510-467e-83d5-1c76af71df41 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:27.024961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a701d9b7d7d84d238d9fdf9c7266497c', 'request_id': 'req-d38fb2fa-e276-4a87-8391-684936160a47'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:27.032586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a701d9b7d7d84d238d9fdf9c7266497c', 'request_id': 'req-d38fb2fa-e276-4a87-8391-684936160a47'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:27.045369 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a701d9b7d7d84d238d9fdf9c7266497c', 'request_id': 'req-d38fb2fa-e276-4a87-8391-684936160a47'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:27.062666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] The token cache is being invalidate because project a701d9b7d7d84d238d9fdf9c7266497c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:27.063168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:27.064139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d38fb2fa-e276-4a87-8391-684936160a47 tempest-VolumeQuotaClassesTest-1407973713 tempest-VolumeQuotaClassesTest-1407973713-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:27.070302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 879/1733] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:26 2022] DELETE /identity/v3/projects/a701d9b7d7d84d238d9fdf9c7266497c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:27.070302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:27.070302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:27.070302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:27.133632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] MFA Rules not processed for user `349daa97405a46e194415ae2dc9c0edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:27.135771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:27.138050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:27.201468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:27.202170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:27.202456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:27.202736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:27.203475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:27.211451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:27.246616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 855/1734] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:27.248124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:27.250328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:27.267689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882f42d-a0ee-48be-88cf-a9fbb13940d3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:27.274188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 880/1735] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:27.279685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39a227-c499-448b-bf4d-6f31f95d1999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:27.281168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a227-c499-448b-bf4d-6f31f95d1999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:27.281412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a227-c499-448b-bf4d-6f31f95d1999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:27.281695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39a227-c499-448b-bf4d-6f31f95d1999 admin admin] PATH_INFO: `/v3/projects/ca1bda5bc2184e4aa47fe2981e768914/users/225ce841ce7349fbaad135861f2496a1/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:27.287750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39a227-c499-448b-bf4d-6f31f95d1999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1bda5bc2184e4aa47fe2981e768914, user_id=225ce841ce7349fbaad135861f2496a1, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:27.291142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:27.292910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:27.296896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39a227-c499-448b-bf4d-6f31f95d1999 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:27.332201 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 856/1736] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:27 2022] PUT /identity/v3/projects/ca1bda5bc2184e4aa47fe2981e768914/users/225ce841ce7349fbaad135861f2496a1/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:27.350417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231e760-8dc6-473e-bef7-7ea41ddce643 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:27.350712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231e760-8dc6-473e-bef7-7ea41ddce643 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:27.351086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231e760-8dc6-473e-bef7-7ea41ddce643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:27.419048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6231e760-8dc6-473e-bef7-7ea41ddce643 None None] MFA Rules not processed for user `225ce841ce7349fbaad135861f2496a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:27.422853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6231e760-8dc6-473e-bef7-7ea41ddce643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:27.479183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc18d8-31d5-4397-aca6-b3f7f6a93a92 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:27.558880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:27.613924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4b52c-04fc-4b40-90b4-bc7a5a09d2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:27.614644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4b52c-04fc-4b40-90b4-bc7a5a09d2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:27.614903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4b52c-04fc-4b40-90b4-bc7a5a09d2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:27.615427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4b52c-04fc-4b40-90b4-bc7a5a09d2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:27.671862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 857/1737] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:27.674361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:27.675228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:27.675833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:27.780068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] MFA Rules not processed for user `a95761f42af64635b051051e397d0fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:27.784137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:28.009250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4b52c-04fc-4b40-90b4-bc7a5a09d2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:28.018920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4b52c-04fc-4b40-90b4-bc7a5a09d2b1 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:28.051252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 858/1738] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:28.056573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 881/1739] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:28.061313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:28.063023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:28.066902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:28.078409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:28.086415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:28.111014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] MFA Rules not processed for user `eadb39271321475ebb10382db43db0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:28.116594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:28.148861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa1f2-09e9-4c69-a4a1-8229280a2fa6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:28.166924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:28.168518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:28.170986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:28.173322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:28.224539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:28.227621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:28.261620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 859/1740] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:28.263401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:28.265977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:28.330750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 882/1741] 10.222.0.62 () {58 vars in 1015 bytes} [Thu May 26 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:28.336504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:28.341602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:28.342980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:28.459893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25de3b-7e34-4155-96c9-af0657b5d68f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:28.482819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:28.484312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:28.487647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:28.488766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:28.524636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:28.527047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:28.572944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 860/1742] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:28.584657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:28.596706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:28.621976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bcfb5-68ed-4849-a35a-18ce9219aae6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:28.638760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:28.646783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:28.647399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:28.647993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] PATH_INFO: `/v3/users/ce32de3f367b44b385704269c4af5bf0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:28.649717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40298-51e6-4d01-90c6-91e189d87687 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:28.651391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce32de3f367b44b385704269c4af5bf0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:28.656688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:28.674853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:28.675738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:28.680970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:28.681421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:28.735316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:28.736519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:28.786444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 861/1743] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:28.794750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:28.836550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:28.843730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688c8c7-3060-429d-9e31-50782fb93bfa service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:28.870002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b6df8-8ad5-4ea7-80f9-26ae99d0f5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:28.873057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b6df8-8ad5-4ea7-80f9-26ae99d0f5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:28.873280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b6df8-8ad5-4ea7-80f9-26ae99d0f5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:28.873630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b6df8-8ad5-4ea7-80f9-26ae99d0f5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:28.885268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d6b6df8-8ad5-4ea7-80f9-26ae99d0f5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:28.889165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce32de3f367b44b385704269c4af5bf0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:28.948866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce32de3f367b44b385704269c4af5bf0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:28.977729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce32de3f367b44b385704269c4af5bf0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.016922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce32de3f367b44b385704269c4af5bf0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.029652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce32de3f367b44b385704269c4af5bf0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.062017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b6df8-8ad5-4ea7-80f9-26ae99d0f5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:29.062846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 883/1744] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:28 2022] DELETE /identity/v3/users/ce32de3f367b44b385704269c4af5bf0 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:29.063511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b6df8-8ad5-4ea7-80f9-26ae99d0f5f6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:29.063859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:29.070330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:29.079066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 862/1745] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:29.080684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:29.080984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:29.081268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:29.130468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:29.132901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:29.344499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 863/1746] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:29.398829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad7eae-cf6a-4896-a217-1579a832cf52 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:29.405548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:29.407360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:29.415185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:29.420171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:29.420171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:29.420354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] PATH_INFO: `/v3/projects/04bc982b9b3d40e0a44205e852c649f0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:29.429698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04bc982b9b3d40e0a44205e852c649f0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:29.438576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:29.641732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04bc982b9b3d40e0a44205e852c649f0', 'request_id': 'req-abdb3bee-4262-4210-a4f1-6b8355d59a19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.656156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:29.667630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04bc982b9b3d40e0a44205e852c649f0', 'request_id': 'req-abdb3bee-4262-4210-a4f1-6b8355d59a19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.691767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04bc982b9b3d40e0a44205e852c649f0', 'request_id': 'req-abdb3bee-4262-4210-a4f1-6b8355d59a19'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.743747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] The token cache is being invalidate because project 04bc982b9b3d40e0a44205e852c649f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:29.743951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33b37f-2e11-4ba7-aa98-4271006df65d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:29.749159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.752960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-abdb3bee-4262-4210-a4f1-6b8355d59a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:29.766988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 884/1747] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:29 2022] DELETE /identity/v3/projects/04bc982b9b3d40e0a44205e852c649f0 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:29.784315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efaccb-21c9-4f9a-a90e-0ec198f507a3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:29.784831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efaccb-21c9-4f9a-a90e-0ec198f507a3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:29.785173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efaccb-21c9-4f9a-a90e-0ec198f507a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:29.870545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-87efaccb-21c9-4f9a-a90e-0ec198f507a3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:29.875836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-87efaccb-21c9-4f9a-a90e-0ec198f507a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:29.996008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:30.000382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:30.000769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:30.000989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:30.011421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:30.068906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:30.219540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 885/1748] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:30.220576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662935b-8e74-46fe-a244-f07458a64098 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:30.220878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662935b-8e74-46fe-a244-f07458a64098 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:30.221163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662935b-8e74-46fe-a244-f07458a64098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:30.303447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9662935b-8e74-46fe-a244-f07458a64098 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:30.311431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9662935b-8e74-46fe-a244-f07458a64098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:30.342614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 886/1749] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:30.347074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662935b-8e74-46fe-a244-f07458a64098 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:30.402991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662935b-8e74-46fe-a244-f07458a64098 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:30.404187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:30.405672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:30.430643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:30.431321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:30.431616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:30.431899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:30.432681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:30.432996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:30.434717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:30.438057 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 864/1750] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1033 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:30.438931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:30.446023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:30.480436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 887/1751] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:30.491083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:30.494624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293ceda-5b84-42c4-bffc-4ee38a53e009 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:30.516035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:30.516992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:30.517241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:30.517520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] PATH_INFO: `/v3/users/0a6b6870943141ee9e9d8290a49bd06b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:30.524320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0efa4-8e10-4670-b31c-f02a9f3939c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:30.526995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6b6870943141ee9e9d8290a49bd06b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:30.528614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:30.547160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:30.549770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:30.550153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:30.552293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:30.554165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:30.563286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:30.665475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 888/1752] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:30 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:30.669249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:30.765541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6b6870943141ee9e9d8290a49bd06b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:30.779133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6b6870943141ee9e9d8290a49bd06b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:30.790986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6b6870943141ee9e9d8290a49bd06b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:30.793244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6b6870943141ee9e9d8290a49bd06b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:30.867751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f7a1592-92e0-4a05-860f-a49766a1a418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6b6870943141ee9e9d8290a49bd06b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:30.899388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 865/1753] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:30 2022] DELETE /identity/v3/users/0a6b6870943141ee9e9d8290a49bd06b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:30.900602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d4bc5-83d1-4096-9f39-e2ce690813d3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:30.900880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d4bc5-83d1-4096-9f39-e2ce690813d3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:30.901166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d4bc5-83d1-4096-9f39-e2ce690813d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:30.958612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-793d4bc5-83d1-4096-9f39-e2ce690813d3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:30.964833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-793d4bc5-83d1-4096-9f39-e2ce690813d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:30.975934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:30.992603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa437e2-f45c-463b-ab24-98dcf185a8ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:31.133628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 866/1754] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:31.135136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:31.135426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:31.135703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:31.141851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:31.142541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:31.142829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:31.143104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:31.143853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:31.147540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:31.183838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] MFA Rules not processed for user `a7cc6fcd7b4c4cee8d21e2692757aaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:31.185718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:31.201263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 889/1755] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:30 2022] POST /identity/v3/users => generated 290 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:31.201263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:31.202437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:31.304537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:31.375460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece0228-7e8a-4cd1-bc2f-674de5381f96 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:31.378116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 867/1756] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:31.380273 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:31.409721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:31.413969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:31.414537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:31.414823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:31.424059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:31.492085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:31.500308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:31.508840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b931c1-ae9c-4890-a63d-a8010e7e8874 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:31.525477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:31.526190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:31.526754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:31.526950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:31.527987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:31.536387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:31.555826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 890/1757] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:31.571859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 868/1758] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:31.574017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:31.576848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:31.583736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:31.631033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a639c2-8679-4a68-9702-4508c401a55c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:31.641482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82321167-a83a-4c04-91fd-1a8af9b35973 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:31.652375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:31.653097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:31.653382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:31.653660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:31.654407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:31.664191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:31.665822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:31.666834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:31.667186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:31.679434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] PATH_INFO: `/v3/projects/e9a25badbbdc47739c49410e0bd3e531` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:31.690246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a25badbbdc47739c49410e0bd3e531)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:31.697553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:31.719516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 869/1759] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:31.721120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:31.775759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb02cd1-335b-4e7e-be74-14a801a35d4f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:31.809781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a7445-f0e9-4fb2-ab3b-e010040eb24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:31.810708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a7445-f0e9-4fb2-ab3b-e010040eb24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:31.810994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a7445-f0e9-4fb2-ab3b-e010040eb24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:31.811265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a7445-f0e9-4fb2-ab3b-e010040eb24b admin admin] PATH_INFO: `/v3/projects/4ab38b001ed84de2bc40e7902d86505e/users/d450b9e962444a8bb3ac019bf64a9aff/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:31.906953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a7445-f0e9-4fb2-ab3b-e010040eb24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab38b001ed84de2bc40e7902d86505e, user_id=d450b9e962444a8bb3ac019bf64a9aff, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:31.929559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a7445-f0e9-4fb2-ab3b-e010040eb24b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:31.956055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a25badbbdc47739c49410e0bd3e531', 'request_id': 'req-28fe018c-1e1a-4457-9280-2aa390c7bd3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:31.974027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a25badbbdc47739c49410e0bd3e531', 'request_id': 'req-28fe018c-1e1a-4457-9280-2aa390c7bd3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.001784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a25badbbdc47739c49410e0bd3e531', 'request_id': 'req-28fe018c-1e1a-4457-9280-2aa390c7bd3b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.020317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 870/1760] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:31 2022] PUT /identity/v3/projects/4ab38b001ed84de2bc40e7902d86505e/users/d450b9e962444a8bb3ac019bf64a9aff/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:32.031836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:32.032766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:32.033197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:32.043384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] The token cache is being invalidate because project e9a25badbbdc47739c49410e0bd3e531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:32.043822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.044764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.057341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 891/1761] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:31 2022] DELETE /identity/v3/projects/e9a25badbbdc47739c49410e0bd3e531 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:32.058508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:32.060120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:32.155863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] MFA Rules not processed for user `d450b9e962444a8bb3ac019bf64a9aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:32.157141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:32.195881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe018c-1e1a-4457-9280-2aa390c7bd3b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:32.405277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:32.406200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:32.406490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:32.406770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] PATH_INFO: `/v3/users/4437c74a3be5435b97b3f561fa281dcb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:32.410692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:32.413741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4437c74a3be5435b97b3f561fa281dcb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:32.415735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:32.426961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 871/1762] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:32.433702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:32.450985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:32.476845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:32.510255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d39ed-e613-466f-87e5-5aef77829b43 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:32.521596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:32.522408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:32.523356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:32.525327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:32.527444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:32.532543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:32.560138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4437c74a3be5435b97b3f561fa281dcb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.600744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4437c74a3be5435b97b3f561fa281dcb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.612480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 872/1763] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:32 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:32.624637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4437c74a3be5435b97b3f561fa281dcb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.625157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:32.652237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4437c74a3be5435b97b3f561fa281dcb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.655796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4437c74a3be5435b97b3f561fa281dcb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:32.678721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 892/1764] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:32 2022] DELETE /identity/v3/users/4437c74a3be5435b97b3f561fa281dcb => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:32.784697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940d4ca-0f6a-4151-84fa-457c4e66d4f8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:32.967406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:32.980254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:32.982000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:32.983180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:32.985824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:32.988500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:33.044385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 873/1765] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:32 2022] POST /identity/v3/users => generated 297 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:33.045055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:33.047076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:33.069966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd490fc-3797-4029-9c83-5dfa60744221 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:33.078704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:33.079487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:33.079846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:33.080229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:33.081922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:33.085008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:33.105352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:33.119069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 893/1766] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:01:33.119685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcd8d-e787-4544-b0b4-9734ed1a407a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:33.130398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:33.131893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:33.132419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:33.132711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] PATH_INFO: `/v3/projects/1f9f3a8431d940b69ce7beee96f4d16a/users/fdc4ea3c3c504cb09412d506b92a4a8c/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:33.161780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9f3a8431d940b69ce7beee96f4d16a, user_id=fdc4ea3c3c504cb09412d506b92a4a8c, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:33.166151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:33.202916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:33.204602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 874/1767] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:33 2022] PUT /identity/v3/projects/1f9f3a8431d940b69ce7beee96f4d16a/users/fdc4ea3c3c504cb09412d506b92a4a8c/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:33.219627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bda32d-1e09-43fd-bbfc-f15bf4f3bacc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:33.329300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ba9c-fc54-4a0d-a35e-cd90edbe03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:33.329300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ba9c-fc54-4a0d-a35e-cd90edbe03fc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:33.329300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ba9c-fc54-4a0d-a35e-cd90edbe03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:33.329300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ba9c-fc54-4a0d-a35e-cd90edbe03fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:33.329770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ba9c-fc54-4a0d-a35e-cd90edbe03fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:33.331262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ba9c-fc54-4a0d-a35e-cd90edbe03fc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:33.349372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:33.350508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 894/1768] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:33.363954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b6ed-fcea-4693-9674-509e69c82c4b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:33.370207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:33.371305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:33.371831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:33.372254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] PATH_INFO: `/v3/projects/1f9f3a8431d940b69ce7beee96f4d16a/users/fdc4ea3c3c504cb09412d506b92a4a8c/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:33.375666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9f3a8431d940b69ce7beee96f4d16a, user_id=fdc4ea3c3c504cb09412d506b92a4a8c, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:33.381605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:33.412210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fd4c-a389-49db-94ed-f7bd64f1e31e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:33.412574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fd4c-a389-49db-94ed-f7bd64f1e31e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:33.412868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fd4c-a389-49db-94ed-f7bd64f1e31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:33.414251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 875/1769] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:33 2022] PUT /identity/v3/projects/1f9f3a8431d940b69ce7beee96f4d16a/users/fdc4ea3c3c504cb09412d506b92a4a8c/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:33.464968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2db2fd4c-a389-49db-94ed-f7bd64f1e31e None None] MFA Rules not processed for user `fdc4ea3c3c504cb09412d506b92a4a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:33.469240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2db2fd4c-a389-49db-94ed-f7bd64f1e31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:33.471972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:33.474810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:33.679352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:33.767071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:33.777519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 895/1770] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:33.777519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9b8c-b9a7-41ac-aba7-daa9798fa62f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:33.777519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9b8c-b9a7-41ac-aba7-daa9798fa62f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:33.777519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9b8c-b9a7-41ac-aba7-daa9798fa62f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:33.777519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 896/1771] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:33.793336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59b9f-9a8c-4c48-ad45-2391208fbe5f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:33.800160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9b8c-b9a7-41ac-aba7-daa9798fa62f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:33.802826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-80fa9b8c-b9a7-41ac-aba7-daa9798fa62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:33.827537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:33.828595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:33.829051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:33.829341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] PATH_INFO: `/v3/projects/65694251c84b4abe8f5b5f24c59832a1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:33.831432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=65694251c84b4abe8f5b5f24c59832a1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:33.839047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:34.039427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65694251c84b4abe8f5b5f24c59832a1', 'request_id': 'req-84960fdc-4dfa-4de5-88f5-764bff648ceb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:34.052484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9b8c-b9a7-41ac-aba7-daa9798fa62f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:34.060765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65694251c84b4abe8f5b5f24c59832a1', 'request_id': 'req-84960fdc-4dfa-4de5-88f5-764bff648ceb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:34.092862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65694251c84b4abe8f5b5f24c59832a1', 'request_id': 'req-84960fdc-4dfa-4de5-88f5-764bff648ceb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:34.146109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] The token cache is being invalidate because project 65694251c84b4abe8f5b5f24c59832a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:34.146420 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:34.147130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84960fdc-4dfa-4de5-88f5-764bff648ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:34.151147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 876/1772] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:33 2022] DELETE /identity/v3/projects/65694251c84b4abe8f5b5f24c59832a1 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:34.152624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:34.152935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:34.153200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:34.226191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:34.241551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:34.242349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:34.242709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:34.243059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:34.244038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:34.251235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:34.561895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 877/1773] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:01:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:34.563461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:34.565201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:34.568775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:34.584933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:34.672154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 897/1774] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 872 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:01:34.673352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:34.682912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:34.869535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:34.891675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d785c0-7c2a-4073-b991-a0dd210e9d17 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:34.912621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:34.913531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:34.913817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:34.914094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] PATH_INFO: `/v3/users/349daa97405a46e194415ae2dc9c0edb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:34.917893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] RBAC: Authorizing `identity:delete_user(user_id=349daa97405a46e194415ae2dc9c0edb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:34.919945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:34.934735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca89e-ad3b-4d89-b568-d26399996767 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:34.958338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:34.958338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:34.958338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:34.958652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] PATH_INFO: `/v3/projects/a004268525cc430dbf4425ff543bea32` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:34.961256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a004268525cc430dbf4425ff543bea32)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:34.969155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:35.016398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:35.086771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349daa97405a46e194415ae2dc9c0edb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.114509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349daa97405a46e194415ae2dc9c0edb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.116042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349daa97405a46e194415ae2dc9c0edb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.117142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349daa97405a46e194415ae2dc9c0edb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.166584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349daa97405a46e194415ae2dc9c0edb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.190661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 878/1775] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:34 2022] DELETE /identity/v3/users/349daa97405a46e194415ae2dc9c0edb => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:35.193615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:35.213898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:35.215620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a004268525cc430dbf4425ff543bea32', 'request_id': 'req-9c1f18f6-9389-4021-8472-60fd73f37352'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.258965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a004268525cc430dbf4425ff543bea32', 'request_id': 'req-9c1f18f6-9389-4021-8472-60fd73f37352'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.280293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a004268525cc430dbf4425ff543bea32', 'request_id': 'req-9c1f18f6-9389-4021-8472-60fd73f37352'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.329729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] The token cache is being invalidate because project a004268525cc430dbf4425ff543bea32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:35.330038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.331333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:35.336947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 898/1776] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:34 2022] DELETE /identity/v3/projects/a004268525cc430dbf4425ff543bea32 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:35.339851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:35.355385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:35.408469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2541e-0a6b-424c-b1a8-c0dc07aa721b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:35.413666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:35.414336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:35.414630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:35.415616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:35.421964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:35.546277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f18f6-9389-4021-8472-60fd73f37352 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:35.642010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:35.667105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:35.713583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 879/1777] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:35.714525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:35.716783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:35.877581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:35.879831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:35.883936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:35.886203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] PATH_INFO: `/v3/users/c810ed954b344a6391ad2ac4a4b31a48` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:35.888128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c810ed954b344a6391ad2ac4a4b31a48)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:35.894079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:35.922905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:36.075948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:36.080194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c810ed954b344a6391ad2ac4a4b31a48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.116945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c810ed954b344a6391ad2ac4a4b31a48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.142793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c810ed954b344a6391ad2ac4a4b31a48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.165811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c810ed954b344a6391ad2ac4a4b31a48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.168833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-156de65e-6bbc-4bf1-a3bc-88dbceaca75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c810ed954b344a6391ad2ac4a4b31a48'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.179852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de0758-fe4d-42fa-a4af-8f81ef5f30a2 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:36.194844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 899/1778] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:35 2022] DELETE /identity/v3/users/c810ed954b344a6391ad2ac4a4b31a48 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:36.198621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:36.198933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:36.199217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:36.213374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6e526-9e51-4dd2-8f46-f35abaa20653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:36.214132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e526-9e51-4dd2-8f46-f35abaa20653 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:36.214408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e526-9e51-4dd2-8f46-f35abaa20653 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:36.214691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e526-9e51-4dd2-8f46-f35abaa20653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:36.224042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0db6e526-9e51-4dd2-8f46-f35abaa20653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:36.288181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:36.295107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:36.319908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e526-9e51-4dd2-8f46-f35abaa20653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:36.337096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e526-9e51-4dd2-8f46-f35abaa20653 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:36.428047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 880/1779] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:36.434342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b44dc-3076-4caf-bd49-052ddec6652a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:36.438521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b44dc-3076-4caf-bd49-052ddec6652a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:36.441178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b44dc-3076-4caf-bd49-052ddec6652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:36.464909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 900/1780] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:36.466842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:36.476232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:36.499706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c2e71-5dfc-4a10-811e-c231f9ec186e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:36.524540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bd5b44dc-3076-4caf-bd49-052ddec6652a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:36.525856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:36.525991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd5b44dc-3076-4caf-bd49-052ddec6652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:36.527264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:36.527569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:36.527862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] PATH_INFO: `/v3/projects/adc196065f724435922a485a46984e59` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:36.529312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc196065f724435922a485a46984e59)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:36.531416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:36.573406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 881/1781] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:36.579399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bad8a-e366-4a03-8502-dd4762335775 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:36.579703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bad8a-e366-4a03-8502-dd4762335775 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:36.580108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bad8a-e366-4a03-8502-dd4762335775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:36.654264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ed4bad8a-e366-4a03-8502-dd4762335775 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:36.657208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed4bad8a-e366-4a03-8502-dd4762335775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:36.682100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc196065f724435922a485a46984e59', 'request_id': 'req-e991bb88-c6ce-489f-94a4-80486d5e2d22'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.701224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc196065f724435922a485a46984e59', 'request_id': 'req-e991bb88-c6ce-489f-94a4-80486d5e2d22'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.728441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc196065f724435922a485a46984e59', 'request_id': 'req-e991bb88-c6ce-489f-94a4-80486d5e2d22'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.757491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] The token cache is being invalidate because project adc196065f724435922a485a46984e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:36.757975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.760711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:36.765589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 901/1782] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:36 2022] DELETE /identity/v3/projects/adc196065f724435922a485a46984e59 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:36.784293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:36.791363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:37.031164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 882/1783] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:37.035350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7eb5-510d-4a60-b509-9c05e0ec4b7a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.035837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7eb5-510d-4a60-b509-9c05e0ec4b7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.036471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7eb5-510d-4a60-b509-9c05e0ec4b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.052503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:37.075053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991bb88-c6ce-489f-94a4-80486d5e2d22 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.079302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72261-f26d-4e57-a224-1c3cf112f2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.079799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5f6c7eb5-510d-4a60-b509-9c05e0ec4b7a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:37.080283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72261-f26d-4e57-a224-1c3cf112f2db service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.080714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72261-f26d-4e57-a224-1c3cf112f2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.081163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72261-f26d-4e57-a224-1c3cf112f2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.084035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f6c7eb5-510d-4a60-b509-9c05e0ec4b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:37.084651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fba72261-f26d-4e57-a224-1c3cf112f2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:37.105964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 883/1784] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:37.107487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c7eb5-510d-4a60-b509-9c05e0ec4b7a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.118806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72261-f26d-4e57-a224-1c3cf112f2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.127205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c7eb5-510d-4a60-b509-9c05e0ec4b7a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.135283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.135506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72261-f26d-4e57-a224-1c3cf112f2db service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.137040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.137717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.139313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.140287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:37.140762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.145181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.164373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 902/1785] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:37.167995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 884/1786] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:37.171302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.177900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93a7c-5ba3-4589-9b9b-b4887fa21dc6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.178316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93a7c-5ba3-4589-9b9b-b4887fa21dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.180349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93a7c-5ba3-4589-9b9b-b4887fa21dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.222032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1226f6-059c-4afe-bd7b-8bcc7ad8bee8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.233824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b4a93a7c-5ba3-4589-9b9b-b4887fa21dc6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:37.237409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b4a93a7c-5ba3-4589-9b9b-b4887fa21dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:37.240485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.242565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.242903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.245412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.247803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.251109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.263852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 903/1787] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:37.275077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93a7c-5ba3-4589-9b9b-b4887fa21dc6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.309210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93a7c-5ba3-4589-9b9b-b4887fa21dc6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.323946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 885/1788] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:37 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:37.325796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.326655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.327581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.328221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.329777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.330757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:37.333779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.335926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.365571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 904/1789] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:37.371651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.403739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372074b-c655-48ac-9734-8361c79a7634 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.561269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145c78-500b-4748-97f2-bdff2ff49927 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.580969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.581932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.583969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.584392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.585230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.585440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.588418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.588891 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.590989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.591461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.592397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.594544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.638050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:37.646040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 886/1790] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:37 2022] POST /identity/v3/users => generated 294 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:01:37.662608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.667599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 905/1791] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:37 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:37.670746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.691628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50058-0e03-4b18-a0da-3707f7e7acf6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.831749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561daab9-bf95-4056-8a03-763f64b05eee admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.844315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.845308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.845706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.846093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.847424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.853504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.872247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.872949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.873225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.873503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.877350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.883017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.899918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 906/1792] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:37 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:37.901311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.933465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 887/1793] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:37.936973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed62f9-f701-464c-9211-4d8f1ef1bf94 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:37.937464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:37.957911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:37.961538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:37.961938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:37.962332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:37.963266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:37.968615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:37.985785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6ab3f-676a-40f9-86f8-44df92ab5e59 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:38.014773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 907/1794] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:38.016462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:38.018470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:38.024806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.025112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.025400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.026200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:38.034488 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:38.070743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 888/1795] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:38.072714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:38.085531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3641-be05-4e82-a67d-4ab754d71f6e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:38.105802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:38.111532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.113117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.113723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.116568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:38.125073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:38.136670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c9171-6f16-4afc-93d9-0c17379ea837 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:38.161699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d24b5-3165-4eb6-ba89-c60278c56652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:38.163979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d24b5-3165-4eb6-ba89-c60278c56652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.180132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d24b5-3165-4eb6-ba89-c60278c56652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.180878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d24b5-3165-4eb6-ba89-c60278c56652 admin admin] PATH_INFO: `/v3/projects/940f20ec02304f96a5dbb4c38c025eae/users/4e6c0f38770f4445a6c222224adc7196/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.195037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 908/1796] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:38.196814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:38.203815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d24b5-3165-4eb6-ba89-c60278c56652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940f20ec02304f96a5dbb4c38c025eae, user_id=4e6c0f38770f4445a6c222224adc7196, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:38.208417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d24b5-3165-4eb6-ba89-c60278c56652 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:38.224938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6b72-1bd2-43a5-b08e-b5f4b358bfba admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:38.260047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 889/1797] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:38 2022] PUT /identity/v3/projects/940f20ec02304f96a5dbb4c38c025eae/users/4e6c0f38770f4445a6c222224adc7196/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:38.260388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d914aad-9d1b-4323-a685-8fa627f5926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:38.260388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d914aad-9d1b-4323-a685-8fa627f5926d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.260388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d914aad-9d1b-4323-a685-8fa627f5926d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.260388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d914aad-9d1b-4323-a685-8fa627f5926d admin admin] PATH_INFO: `/v3/projects/73ef673c7ff74dbabf5066a72d8395ba/users/2f8924e2e65f49ac9b24b8503a5d4d00/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.274623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d914aad-9d1b-4323-a685-8fa627f5926d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ef673c7ff74dbabf5066a72d8395ba, user_id=2f8924e2e65f49ac9b24b8503a5d4d00, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:38.275907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18315b-d9d8-4617-89eb-4e4669a93414 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.276297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18315b-d9d8-4617-89eb-4e4669a93414 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.276657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18315b-d9d8-4617-89eb-4e4669a93414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.277261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d914aad-9d1b-4323-a685-8fa627f5926d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:38.290398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:38.306508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 909/1798] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:38 2022] PUT /identity/v3/projects/73ef673c7ff74dbabf5066a72d8395ba/users/2f8924e2e65f49ac9b24b8503a5d4d00/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:38.314468 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.316733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.317142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.379909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ad18315b-d9d8-4617-89eb-4e4669a93414 None None] MFA Rules not processed for user `4e6c0f38770f4445a6c222224adc7196`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:38.387884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ad18315b-d9d8-4617-89eb-4e4669a93414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:38.413671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] MFA Rules not processed for user `2f8924e2e65f49ac9b24b8503a5d4d00`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:38.418610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:38.650016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 890/1799] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:38.654376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18315b-d9d8-4617-89eb-4e4669a93414 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:38.674581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 910/1800] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:38.688724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:38.692273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:38.891441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:38.936534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18315b-d9d8-4617-89eb-4e4669a93414 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:38.937368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db833d-ab7b-4934-8233-718cbbda14b5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:38.950269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:38.952547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.953891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.953891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.954180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:38.955094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:38.958642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:38.959450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:38.961641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:38.981201 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:39.009016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:39.010642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:39.051289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 911/1801] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:39.075675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:39.087560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 891/1802] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:38 2022] POST /identity/v3/projects => generated 389 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:39.091464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:39.102294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1734f6-56ed-477d-a591-fc44367aab64 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:39.292239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c5f6-90de-4265-bda9-70a6289f604a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:39.295908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:39.297573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:39.299969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:39.301305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] PATH_INFO: `/v3/users/2f8924e2e65f49ac9b24b8503a5d4d00` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:39.303316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8924e2e65f49ac9b24b8503a5d4d00)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:39.306869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:39.307697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:39.309275 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:39.309706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:39.311816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:39.314158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:39.319136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:39.390638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 892/1803] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:39 2022] POST /identity/v3/users => generated 301 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:39.398899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:39.414507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:39.433844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138d46-6326-466e-828a-c079c1b34156 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:39.441257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:39.441771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:39.442071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:39.442609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:39.443744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:39.445725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:39.453685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8924e2e65f49ac9b24b8503a5d4d00'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:39.471013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 893/1804] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:39.472206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:39.504785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8924e2e65f49ac9b24b8503a5d4d00'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:39.511052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb009abb-84a7-4a46-a7f3-0c497c98eefe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:39.517404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8924e2e65f49ac9b24b8503a5d4d00'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:39.532455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8924e2e65f49ac9b24b8503a5d4d00'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:39.534916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dddb722-5aab-41ca-9dec-a0239dbf6408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8924e2e65f49ac9b24b8503a5d4d00'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:39.551254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 912/1805] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:39 2022] DELETE /identity/v3/users/2f8924e2e65f49ac9b24b8503a5d4d00 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:39.553357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:39.553769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:39.554133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:39.554292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:39.555334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:39.555918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:39.556414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] PATH_INFO: `/v3/projects/a400ad2167bc4fe4b54be66750a5fdfe/users/078fb8f0158740e29a52e217ac3b955d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:39.587098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:39.589565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:39.591538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a400ad2167bc4fe4b54be66750a5fdfe, user_id=078fb8f0158740e29a52e217ac3b955d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:39.595536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:39.644923 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 894/1806] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:39 2022] PUT /identity/v3/projects/a400ad2167bc4fe4b54be66750a5fdfe/users/078fb8f0158740e29a52e217ac3b955d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:39.646779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:39.651569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:39.801629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 913/1807] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:39.893153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:39.894965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:40.013906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409c6d-9bc1-4c80-be61-563e02e51bfe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:40.018920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb3a1f-3144-4bff-89ff-ee344e7f7ba6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:40.033669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:40.035830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.037869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.039020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.040753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:40.045836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:40.103892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 895/1808] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:40.107876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:40.150964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671182d-c81f-44e4-99dc-132850778ce3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:40.176374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e98066-070a-4c04-aea0-cd1ff62886a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:40.177626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e98066-070a-4c04-aea0-cd1ff62886a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.183560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e98066-070a-4c04-aea0-cd1ff62886a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.184044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e98066-070a-4c04-aea0-cd1ff62886a3 admin admin] PATH_INFO: `/v3/projects/a400ad2167bc4fe4b54be66750a5fdfe/users/078fb8f0158740e29a52e217ac3b955d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.192498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e98066-070a-4c04-aea0-cd1ff62886a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a400ad2167bc4fe4b54be66750a5fdfe, user_id=078fb8f0158740e29a52e217ac3b955d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:40.200133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e98066-070a-4c04-aea0-cd1ff62886a3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:40.241022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f44a4-7b20-4141-aae8-c52cb1b64d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:40.243934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f44a4-7b20-4141-aae8-c52cb1b64d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.244317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f44a4-7b20-4141-aae8-c52cb1b64d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.244642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f44a4-7b20-4141-aae8-c52cb1b64d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.266748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 896/1809] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:40 2022] PUT /identity/v3/projects/a400ad2167bc4fe4b54be66750a5fdfe/users/078fb8f0158740e29a52e217ac3b955d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:40.274089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.277139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.277725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.295312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f44a4-7b20-4141-aae8-c52cb1b64d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:40.303979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f44a4-7b20-4141-aae8-c52cb1b64d07 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:40.355467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:40.355863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 914/1810] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:01:40.357471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473c315-4095-4ce9-93c6-d34923dfc937 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.358015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473c315-4095-4ce9-93c6-d34923dfc937 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.358352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473c315-4095-4ce9-93c6-d34923dfc937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.385266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] MFA Rules not processed for user `5b5c8dedd274447da8ee4600feb6a26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:40.392880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:40.458323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:40.509757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5473c315-4095-4ce9-93c6-d34923dfc937 None None] MFA Rules not processed for user `078fb8f0158740e29a52e217ac3b955d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:40.511856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5473c315-4095-4ce9-93c6-d34923dfc937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:40.633456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 897/1811] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:40.635922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:40.640476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:40.750245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 915/1812] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:40.751646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70a9d-4a67-4633-9b95-ccd88580a795 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.751936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70a9d-4a67-4633-9b95-ccd88580a795 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.752307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70a9d-4a67-4633-9b95-ccd88580a795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.788201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-32a70a9d-4a67-4633-9b95-ccd88580a795 None None] MFA Rules not processed for user `5b5c8dedd274447da8ee4600feb6a26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:40.791017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-32a70a9d-4a67-4633-9b95-ccd88580a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:40.792223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560419e-fa8f-4a58-b2db-efebf271f2ad None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:40.807306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:40.809054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.817053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 916/1813] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:40.817053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405dcc-835f-4070-9748-f215824bf202 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:40.817053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405dcc-835f-4070-9748-f215824bf202 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.817053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405dcc-835f-4070-9748-f215824bf202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.820138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:40.820854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] PATH_INFO: `/v3/projects/557338c937664207b42f14a48217f194` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:40.823818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557338c937664207b42f14a48217f194)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:40.826104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:40.844722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-56405dcc-835f-4070-9748-f215824bf202 None None] MFA Rules not processed for user `a95761f42af64635b051051e397d0fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:40.846123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56405dcc-835f-4070-9748-f215824bf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:40.936540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557338c937664207b42f14a48217f194', 'request_id': 'req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:40.954862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557338c937664207b42f14a48217f194', 'request_id': 'req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:40.962509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 917/1814] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:40.969271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56405dcc-835f-4070-9748-f215824bf202 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:40.970936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557338c937664207b42f14a48217f194', 'request_id': 'req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:40.973472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56405dcc-835f-4070-9748-f215824bf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:40.994717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] The token cache is being invalidate because project 557338c937664207b42f14a48217f194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:40.994960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:40.997692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.004746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 898/1815] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:40 2022] DELETE /identity/v3/projects/557338c937664207b42f14a48217f194 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:41.004746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:41.006449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:41.079799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:41.127050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56405dcc-835f-4070-9748-f215824bf202 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:41.179231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab5a6-6ef9-4d3c-bad1-b914bedd3b19 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:41.192110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:41.192721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:41.193008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:41.193290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:41.206774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:41.217393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:41.226159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:41.226849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:41.227188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:41.227431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:41.233313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:41.327908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:41.330224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:41.346204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 899/1816] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:41.348812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:41.351956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:41.375878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:41.377483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:41.399294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 918/1817] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:41.431245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:41.432460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:41.476184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccee3bb-928c-402d-adff-31e424381b21 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:41.482041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:41.484080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:41.485000 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:41.485547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] PATH_INFO: `/v3/users/225ce841ce7349fbaad135861f2496a1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:41.487470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=225ce841ce7349fbaad135861f2496a1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:41.495174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:41.579950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225ce841ce7349fbaad135861f2496a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.605968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225ce841ce7349fbaad135861f2496a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.607120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225ce841ce7349fbaad135861f2496a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.608401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225ce841ce7349fbaad135861f2496a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.643959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34d3bf-4bba-4b9d-ada6-a8baba3b0c09 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:41.653919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:41.657542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225ce841ce7349fbaad135861f2496a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.667999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:41.671004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:41.671297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:41.671585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] PATH_INFO: `/v3/projects/73ef673c7ff74dbabf5066a72d8395ba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:41.680438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ef673c7ff74dbabf5066a72d8395ba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:41.682183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:41.686551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 900/1818] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:41 2022] DELETE /identity/v3/users/225ce841ce7349fbaad135861f2496a1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:41.687424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:41.688965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:41.810596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ef673c7ff74dbabf5066a72d8395ba', 'request_id': 'req-b46f1cc7-4519-4a17-90a4-a77d370e8717'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.824195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ef673c7ff74dbabf5066a72d8395ba', 'request_id': 'req-b46f1cc7-4519-4a17-90a4-a77d370e8717'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.837441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ef673c7ff74dbabf5066a72d8395ba', 'request_id': 'req-b46f1cc7-4519-4a17-90a4-a77d370e8717'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.860875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad20bf-1880-45ed-b17b-2c4361399d5a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:41.862872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] The token cache is being invalidate because project 73ef673c7ff74dbabf5066a72d8395ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:41.863516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.864339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b46f1cc7-4519-4a17-90a4-a77d370e8717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:41.869766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 919/1819] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:41 2022] DELETE /identity/v3/projects/73ef673c7ff74dbabf5066a72d8395ba => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:41.871594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213393b4-07cf-4331-b9c0-508a906239ec None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:41.872438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213393b4-07cf-4331-b9c0-508a906239ec None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:41.875302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213393b4-07cf-4331-b9c0-508a906239ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:41.907005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-213393b4-07cf-4331-b9c0-508a906239ec None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:41.910348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-213393b4-07cf-4331-b9c0-508a906239ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:41.960545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:41.992235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:41.993129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:41.993421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:41.994204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] PATH_INFO: `/v3/users/4e6c0f38770f4445a6c222224adc7196` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:41.995110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6c0f38770f4445a6c222224adc7196)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:41.997149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:42.038888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 920/1820] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:42.038888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a70ce-303d-4181-b980-fd01f77419ce None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.038888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a70ce-303d-4181-b980-fd01f77419ce None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.038888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a70ce-303d-4181-b980-fd01f77419ce None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.038888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 921/1821] 10.222.0.69 () {54 vars in 912 bytes} [Thu May 26 18:01:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:42.041405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd70c0-9a03-4596-94e5-0a6ac7d04bba None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.041774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd70c0-9a03-4596-94e5-0a6ac7d04bba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.042130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd70c0-9a03-4596-94e5-0a6ac7d04bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.109852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6c0f38770f4445a6c222224adc7196'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.114016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4cbd70c0-9a03-4596-94e5-0a6ac7d04bba None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:42.116684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4cbd70c0-9a03-4596-94e5-0a6ac7d04bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:42.134253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 922/1822] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:42.136946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8051-ed16-4c5f-b0ef-ca1e11c88dce None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.137461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8051-ed16-4c5f-b0ef-ca1e11c88dce None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.137720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6c0f38770f4445a6c222224adc7196'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.137956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8051-ed16-4c5f-b0ef-ca1e11c88dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.140631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6c0f38770f4445a6c222224adc7196'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.143222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6c0f38770f4445a6c222224adc7196'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.175446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6c0f38770f4445a6c222224adc7196'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.200591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4f2b8051-ed16-4c5f-b0ef-ca1e11c88dce None None] MFA Rules not processed for user `eadb39271321475ebb10382db43db0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:42.202329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 901/1823] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:41 2022] DELETE /identity/v3/users/4e6c0f38770f4445a6c222224adc7196 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:42.203308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:42.211132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4f2b8051-ed16-4c5f-b0ef-ca1e11c88dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:42.216908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:42.251051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:42.452294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54258bd1-be92-4709-be4d-1af7f9e3e0a5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:42.461966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 923/1824] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:42.464587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.465039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.465508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.497670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:42.498204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.498494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.498780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.499529 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:42.499845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:42.501582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:42.507610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:42.511561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:42.523272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 924/1825] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:42.525129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:42.526683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:42.536792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 902/1826] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:42.541817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:42.552280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a2f2-c3de-4cc1-aae8-a35db9e23456 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:42.557532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:42.558332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.558761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d064fc-0dc2-452b-8499-ccb6901489c2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:42.558901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.559219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.569459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:42.570313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.570603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.570891 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.573285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:42.578801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:42.594364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:42.596071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:42.603866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 925/1827] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:42.605421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:42.621539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad252236-7f49-4abe-8189-3bb5e3f8ded8 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:42.626100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 903/1828] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:42.626964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:42.627143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:42.628225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.629316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.629797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.630616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:42.632517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:42.634616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:42.658902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676f7b1-13eb-4c79-b5f9-9062f4be4cdf service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:42.674002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:42.674956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.675250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.675722 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] PATH_INFO: `/v3/projects/ca1bda5bc2184e4aa47fe2981e768914` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.681735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1bda5bc2184e4aa47fe2981e768914)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:42.683725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:42.715409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 926/1829] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:42 2022] POST /identity/v3/projects => generated 359 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:42.723798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:42.793127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1bda5bc2184e4aa47fe2981e768914', 'request_id': 'req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.804876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1bda5bc2184e4aa47fe2981e768914', 'request_id': 'req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.823417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1bda5bc2184e4aa47fe2981e768914', 'request_id': 'req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.846595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] The token cache is being invalidate because project ca1bda5bc2184e4aa47fe2981e768914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:42.847886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.849785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b863d0c2-dde7-4539-8a1a-aeb2eb510d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:42.856361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 904/1830] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:42 2022] DELETE /identity/v3/projects/ca1bda5bc2184e4aa47fe2981e768914 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:42.858343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e68d4b-f98c-4b90-8dd0-d29cb2c07a55 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:42.858492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e68d4b-f98c-4b90-8dd0-d29cb2c07a55 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:42.859036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e68d4b-f98c-4b90-8dd0-d29cb2c07a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:42.908082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-83e68d4b-f98c-4b90-8dd0-d29cb2c07a55 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:42.914117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83e68d4b-f98c-4b90-8dd0-d29cb2c07a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:42.942508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa009c-e082-433a-9bcf-26484657f3ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.025911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:43.043679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 905/1831] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:43.048123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c02f6-5616-4bda-bac0-5963c362214e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.048590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c02f6-5616-4bda-bac0-5963c362214e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.050660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c02f6-5616-4bda-bac0-5963c362214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.071842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.072569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.072863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.073146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.073861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.075895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.082690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-023c02f6-5616-4bda-bac0-5963c362214e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:43.084899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-023c02f6-5616-4bda-bac0-5963c362214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.118303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 927/1832] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:42 2022] POST /identity/v3/users => generated 280 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:43.119459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.124818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 906/1833] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:43.129737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.130388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c02f6-5616-4bda-bac0-5963c362214e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.147912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6e0ec-d57b-427c-98da-96b1917ad3dd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.161809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.162587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.162812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.163078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.163826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.165736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.167447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c02f6-5616-4bda-bac0-5963c362214e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.180367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.181267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.182045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.182518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.184853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:43.186787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.188818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 928/1834] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:01:43.199644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.202831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.220857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:43.227616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5457-0bf5-40f0-8b13-b295ccf2ee17 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.238945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 907/1835] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:43.240119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.245510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.246479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.246994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.247491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.248495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.250574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.256638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34bda4-e3da-4043-8391-ad4f8086025c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.269245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.270320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.270663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.271009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.271791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.273798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.277814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 929/1836] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:43.290330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.308239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf154-6fc7-43c0-ab66-c72d553dd5ca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.321457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1611c3-db96-4e5c-ab53-34076fd6157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.322756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1611c3-db96-4e5c-ab53-34076fd6157a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.323271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1611c3-db96-4e5c-ab53-34076fd6157a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.323780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1611c3-db96-4e5c-ab53-34076fd6157a admin admin] PATH_INFO: `/v3/projects/bc72a8cb97894449b01838ceeb7635cb/users/20300cdf4a7e48a094c185f13c6110c4/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.338677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 908/1837] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:43 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:43.344107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.353639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1611c3-db96-4e5c-ab53-34076fd6157a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc72a8cb97894449b01838ceeb7635cb, user_id=20300cdf4a7e48a094c185f13c6110c4, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.366049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1611c3-db96-4e5c-ab53-34076fd6157a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.428051 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 930/1838] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:43 2022] PUT /identity/v3/projects/bc72a8cb97894449b01838ceeb7635cb/users/20300cdf4a7e48a094c185f13c6110c4/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:43.433912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936011-843f-4647-847e-960f1e3a6d07 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.434683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936011-843f-4647-847e-960f1e3a6d07 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.435450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936011-843f-4647-847e-960f1e3a6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.455203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f514-1977-489e-bfa3-33d14a962b9e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.487918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8c936011-843f-4647-847e-960f1e3a6d07 None None] MFA Rules not processed for user `20300cdf4a7e48a094c185f13c6110c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:43.493257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8c936011-843f-4647-847e-960f1e3a6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.544246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.545624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.545624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.545757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.546652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.549492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.591071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 909/1839] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:43 2022] POST /identity/v3/users => generated 305 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:43.591071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.610528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.620652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd58e37-5812-4932-8a51-89d15894f8b3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.630169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.631497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.631497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.631663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] PATH_INFO: `/v3/projects/940f20ec02304f96a5dbb4c38c025eae` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.633432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940f20ec02304f96a5dbb4c38c025eae)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.635359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.673765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 931/1840] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:43.673765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c936011-843f-4647-847e-960f1e3a6d07 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.682338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c936011-843f-4647-847e-960f1e3a6d07 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.689016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04dbbe-9b6a-4033-a5e1-362a6d8ba2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.690134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04dbbe-9b6a-4033-a5e1-362a6d8ba2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.690447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04dbbe-9b6a-4033-a5e1-362a6d8ba2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.690773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04dbbe-9b6a-4033-a5e1-362a6d8ba2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.703172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04dbbe-9b6a-4033-a5e1-362a6d8ba2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:43.704783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04dbbe-9b6a-4033-a5e1-362a6d8ba2bf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:43.722318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 932/1841] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:43.724937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.727784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.728106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.732692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940f20ec02304f96a5dbb4c38c025eae', 'request_id': 'req-a628da45-101e-4606-89c5-0fe98f8e05a5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:43.741951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940f20ec02304f96a5dbb4c38c025eae', 'request_id': 'req-a628da45-101e-4606-89c5-0fe98f8e05a5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:43.756628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940f20ec02304f96a5dbb4c38c025eae', 'request_id': 'req-a628da45-101e-4606-89c5-0fe98f8e05a5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:43.764479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:43.779315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] The token cache is being invalidate because project 940f20ec02304f96a5dbb4c38c025eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:43.779642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:43.785406 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:43.786728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] MFA Rules not processed for user `5b5c8dedd274447da8ee4600feb6a26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:43.788247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 910/1842] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:43 2022] DELETE /identity/v3/projects/940f20ec02304f96a5dbb4c38c025eae => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:43.789120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.790461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.790943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.908430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628da45-101e-4606-89c5-0fe98f8e05a5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:43.915188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:43.916410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:43.916980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:43.917277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:43.919767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.938943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 933/1843] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:43.940204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:43.948096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:43.958790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:44.058469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:44.063086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:44.080343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 911/1844] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:44.082129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:44.089061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:44.112930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50987850-2c1a-424c-b2ab-d71dfeea6370 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:44.121451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:44.122149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:44.122441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:44.122719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:44.125672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:44.127337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:44.130459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f03dd4-92b2-49b3-b69e-0d1675a12fd5 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:44.142079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:44.142944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:44.143233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:44.144100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] PATH_INFO: `/v3/users/078fb8f0158740e29a52e217ac3b955d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:44.145698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=078fb8f0158740e29a52e217ac3b955d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:44.151155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:44.163547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 934/1845] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:44.165801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:44.173322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:44.202588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac2816-98b2-4f23-88d1-bd8d33e6b111 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:44.246560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:44.247854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:44.248538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:44.248975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] PATH_INFO: `/v3/users/20300cdf4a7e48a094c185f13c6110c4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:44.251537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=20300cdf4a7e48a094c185f13c6110c4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:44.256343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:44.294327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078fb8f0158740e29a52e217ac3b955d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.312483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078fb8f0158740e29a52e217ac3b955d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.313642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078fb8f0158740e29a52e217ac3b955d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.314601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078fb8f0158740e29a52e217ac3b955d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.370787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078fb8f0158740e29a52e217ac3b955d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.395282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 912/1846] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:44 2022] DELETE /identity/v3/users/078fb8f0158740e29a52e217ac3b955d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:44.396588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:44.398284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:44.399168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20300cdf4a7e48a094c185f13c6110c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.433095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20300cdf4a7e48a094c185f13c6110c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.445892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20300cdf4a7e48a094c185f13c6110c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.462840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:44.463650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20300cdf4a7e48a094c185f13c6110c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.464253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-40ef46ab-e162-4000-9f46-2686c1b07cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20300cdf4a7e48a094c185f13c6110c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:44.492581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 935/1847] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:44 2022] DELETE /identity/v3/users/20300cdf4a7e48a094c185f13c6110c4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:44.496976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:44.497399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:44.497783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:44.543742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:44.545566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:44.638564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce331-3683-4a6c-907a-9a7518a5a04e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:44.687539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 936/1848] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:44.821745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:44.823237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:44.852944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:44.871661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0843-37d9-40f9-b754-b219f8074291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:44.872329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0843-37d9-40f9-b754-b219f8074291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:44.874117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0843-37d9-40f9-b754-b219f8074291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:44.874631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0843-37d9-40f9-b754-b219f8074291 admin admin] PATH_INFO: `/v3/projects/aecd1d266a074d04a0efa437f4729323/users/2e4ab0f8d1354862b6ac8c726d621e9b/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:44.927651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0843-37d9-40f9-b754-b219f8074291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecd1d266a074d04a0efa437f4729323, user_id=2e4ab0f8d1354862b6ac8c726d621e9b, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:44.938236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0843-37d9-40f9-b754-b219f8074291 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:44.972834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 913/1849] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:44 2022] PUT /identity/v3/projects/aecd1d266a074d04a0efa437f4729323/users/2e4ab0f8d1354862b6ac8c726d621e9b/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:44.991118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:44.991410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:44.991694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:45.003189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53d43c-84dc-4423-a8bd-d435cb222782 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:45.064969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] MFA Rules not processed for user `2e4ab0f8d1354862b6ac8c726d621e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:45.068435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:45.236781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:45.238928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:45.239233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:45.239504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:45.409586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 914/1850] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:45.414640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:45.418081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:45.419043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:45.421125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:45.438846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 937/1851] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:01:45.447146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7336d-e09a-4e6d-9f52-5319b59de48c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:45.454747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:45.454747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:45.454747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:45.454747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:45.455173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:45.457186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:45.543148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 915/1852] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:45 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:45.547686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:45.574997 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658351-779a-4496-aea2-f94c7192354f service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:45.724306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:45.725555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:45.726060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:45.726579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:45.727660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:45.730048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:45.761087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 938/1853] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:45 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:45.764927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:45.777706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf71732-86e7-4e63-ac2b-0aff746e6ec5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:45.783064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:45.784937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:45.785531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:45.786008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:45.787692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:45.789562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:45.809434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 916/1854] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:01:45.811077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:45.826305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f594-153a-4919-b8da-d99dbb7c4bf4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:45.844635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:45.845948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:45.846577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:45.847297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] PATH_INFO: `/v3/projects/ff26caea75104b3198e09035faac5c5f/users/c7667aa248094ce29176c39b981fd985/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:45.851938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:45.869089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff26caea75104b3198e09035faac5c5f, user_id=c7667aa248094ce29176c39b981fd985, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:45.873118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:45.897178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 939/1855] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:45 2022] PUT /identity/v3/projects/ff26caea75104b3198e09035faac5c5f/users/c7667aa248094ce29176c39b981fd985/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:45.898395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:45.912462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45aae5-1ff9-4944-9a06-58257dc2fcec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:45.920913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:46.065869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717b121-5eb2-4def-ac28-a74f48069bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:46.067094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717b121-5eb2-4def-ac28-a74f48069bba admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:46.067397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717b121-5eb2-4def-ac28-a74f48069bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:46.067681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717b121-5eb2-4def-ac28-a74f48069bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:46.073627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717b121-5eb2-4def-ac28-a74f48069bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:46.080338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717b121-5eb2-4def-ac28-a74f48069bba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:46.108169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 917/1856] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:46.112723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:46.129261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461463-ecf3-4189-a617-cbe8e311ad47 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:46.143187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:46.144221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:46.144630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:46.144952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] PATH_INFO: `/v3/projects/ff26caea75104b3198e09035faac5c5f/users/c7667aa248094ce29176c39b981fd985/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:46.156535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff26caea75104b3198e09035faac5c5f, user_id=c7667aa248094ce29176c39b981fd985, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:46.160114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:46.192958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 940/1857] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:46 2022] PUT /identity/v3/projects/ff26caea75104b3198e09035faac5c5f/users/c7667aa248094ce29176c39b981fd985/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:46.194340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128392-6988-4788-b7b1-4055665e79de None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:46.194645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128392-6988-4788-b7b1-4055665e79de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:46.194930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128392-6988-4788-b7b1-4055665e79de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:46.274282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5e128392-6988-4788-b7b1-4055665e79de None None] MFA Rules not processed for user `c7667aa248094ce29176c39b981fd985`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:46.281193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5e128392-6988-4788-b7b1-4055665e79de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:46.470972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 918/1858] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:46.477024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:46.479399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:46.486239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128392-6988-4788-b7b1-4055665e79de None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:46.491245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5e128392-6988-4788-b7b1-4055665e79de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:46.705988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128392-6988-4788-b7b1-4055665e79de None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:46.711254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1916af-8922-4d46-bf90-803189e69bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:46.717572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1916af-8922-4d46-bf90-803189e69bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:46.718070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1916af-8922-4d46-bf90-803189e69bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:46.718506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1916af-8922-4d46-bf90-803189e69bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:46.721314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f6bf-1055-4c8c-a26f-d618ee1d2d07 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:46.743396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:46.744415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:46.744706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:46.744991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] PATH_INFO: `/v3/projects/a400ad2167bc4fe4b54be66750a5fdfe` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:46.747053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a400ad2167bc4fe4b54be66750a5fdfe)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:46.751290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:46.820367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1916af-8922-4d46-bf90-803189e69bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:46.829209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1916af-8922-4d46-bf90-803189e69bd7 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:46.851939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 919/1859] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:46.881955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a400ad2167bc4fe4b54be66750a5fdfe', 'request_id': 'req-7846837e-2b63-48ed-8176-0bc76d256997'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:46.899132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a400ad2167bc4fe4b54be66750a5fdfe', 'request_id': 'req-7846837e-2b63-48ed-8176-0bc76d256997'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:46.914610 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a400ad2167bc4fe4b54be66750a5fdfe', 'request_id': 'req-7846837e-2b63-48ed-8176-0bc76d256997'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:46.939521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] The token cache is being invalidate because project a400ad2167bc4fe4b54be66750a5fdfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:46.939823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:46.941594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:46.944889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 941/1860] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:46 2022] DELETE /identity/v3/projects/a400ad2167bc4fe4b54be66750a5fdfe => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:46.950938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc97c5-ade6-42e7-b8e0-3318a07f5d32 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:46.951351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc97c5-ade6-42e7-b8e0-3318a07f5d32 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:46.952565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc97c5-ade6-42e7-b8e0-3318a07f5d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:46.970629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:46.972281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:46.997296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-11bc97c5-ade6-42e7-b8e0-3318a07f5d32 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:47.001477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-11bc97c5-ade6-42e7-b8e0-3318a07f5d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:47.113312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:47.204175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846837e-2b63-48ed-8176-0bc76d256997 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:47.216262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 920/1861] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:47.217357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:47.218259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.218552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.219001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] PATH_INFO: `/v3/users/d450b9e962444a8bb3ac019bf64a9aff` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.220277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d450b9e962444a8bb3ac019bf64a9aff)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:47.225170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.225490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.225777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.238130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:47.241417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:47.305400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:47.307487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:47.326338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 921/1862] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:47.328635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:47.333504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:47.356399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd450b9e962444a8bb3ac019bf64a9aff'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.363077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffb17d-9c3d-4743-bea1-c7a27563fbac None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:47.373514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:47.377268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.377694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd450b9e962444a8bb3ac019bf64a9aff'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.378078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.379377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] PATH_INFO: `/v3/projects/bc72a8cb97894449b01838ceeb7635cb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.382051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc72a8cb97894449b01838ceeb7635cb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:47.388880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:47.400415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd450b9e962444a8bb3ac019bf64a9aff'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.417927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd450b9e962444a8bb3ac019bf64a9aff'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.419909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd450b9e962444a8bb3ac019bf64a9aff'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.430736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 942/1863] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:46 2022] DELETE /identity/v3/users/d450b9e962444a8bb3ac019bf64a9aff => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:47.438088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:47.440753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:47.520698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc72a8cb97894449b01838ceeb7635cb', 'request_id': 'req-f9f113e3-40db-419a-8e15-b69887717142'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.537264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc72a8cb97894449b01838ceeb7635cb', 'request_id': 'req-f9f113e3-40db-419a-8e15-b69887717142'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.552268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09d87e-bf51-4f24-a789-f33a3d88503b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:47.556908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc72a8cb97894449b01838ceeb7635cb', 'request_id': 'req-f9f113e3-40db-419a-8e15-b69887717142'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.627888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] The token cache is being invalidate because project bc72a8cb97894449b01838ceeb7635cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:47.628314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.633151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:47.636919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 922/1864] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:47 2022] DELETE /identity/v3/projects/bc72a8cb97894449b01838ceeb7635cb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:47.639581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:47.643710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:47.673065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb6500-e6d7-4631-b15f-2f907f09f5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:47.675177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6500-e6d7-4631-b15f-2f907f09f5ad service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.675674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6500-e6d7-4631-b15f-2f907f09f5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.676174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb6500-e6d7-4631-b15f-2f907f09f5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.681026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1eb6500-e6d7-4631-b15f-2f907f09f5ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:47.784587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:47.806238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb6500-e6d7-4631-b15f-2f907f09f5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:47.809411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb6500-e6d7-4631-b15f-2f907f09f5ad service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:47.854145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 943/1865] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:47.855368 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f113e3-40db-419a-8e15-b69887717142 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:47.860579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6b65-ae43-4c0d-9de5-a1927fe117ec None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.863466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6b65-ae43-4c0d-9de5-a1927fe117ec None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.865362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6b65-ae43-4c0d-9de5-a1927fe117ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.873578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ad62-1346-4fce-9158-e5a8c8b3dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:47.874736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ad62-1346-4fce-9158-e5a8c8b3dba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.875027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ad62-1346-4fce-9158-e5a8c8b3dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.875309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ad62-1346-4fce-9158-e5a8c8b3dba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.876083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ad62-1346-4fce-9158-e5a8c8b3dba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:47.876404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ad62-1346-4fce-9158-e5a8c8b3dba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:47.880598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ad62-1346-4fce-9158-e5a8c8b3dba6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:47.911100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 923/1866] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:47.911100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b134578-0413-428f-9280-dc5e074dbbb9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.911100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b134578-0413-428f-9280-dc5e074dbbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.911422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b134578-0413-428f-9280-dc5e074dbbb9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.914522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 924/1867] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:47.915844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc9002-50f4-4be1-888c-77582f678163 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:47.916173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc9002-50f4-4be1-888c-77582f678163 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:47.916459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc9002-50f4-4be1-888c-77582f678163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:47.925216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b85b6b65-ae43-4c0d-9de5-a1927fe117ec None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:47.928969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b85b6b65-ae43-4c0d-9de5-a1927fe117ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:47.956335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 944/1868] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:47.960367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b6b65-ae43-4c0d-9de5-a1927fe117ec None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:47.989175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ccdc9002-50f4-4be1-888c-77582f678163 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:47.991547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b6b65-ae43-4c0d-9de5-a1927fe117ec None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:47.991864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ccdc9002-50f4-4be1-888c-77582f678163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:48.001092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.002125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.002670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.003108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.003969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.006722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.045966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 925/1869] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:48.054499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866390e-3e77-4d3e-9100-d114f5e1cf69 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.055277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 945/1870] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:47 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:48.056407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.059398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866390e-3e77-4d3e-9100-d114f5e1cf69 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.059732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866390e-3e77-4d3e-9100-d114f5e1cf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.069690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:48.176477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7866390e-3e77-4d3e-9100-d114f5e1cf69 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:48.182946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7866390e-3e77-4d3e-9100-d114f5e1cf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:48.192443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8803282-d114-4465-8904-3b92bdaabac4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.198793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7c5e4-071d-4a72-8703-1554d2cf4214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.199600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c5e4-071d-4a72-8703-1554d2cf4214 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.200228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c5e4-071d-4a72-8703-1554d2cf4214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.200847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c5e4-071d-4a72-8703-1554d2cf4214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.330407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:48.346988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7c5e4-071d-4a72-8703-1554d2cf4214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.348059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7c5e4-071d-4a72-8703-1554d2cf4214 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.371181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 946/1871] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:48.372549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558ed1-daa1-4709-ab38-e31c8934ba90 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.372876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558ed1-daa1-4709-ab38-e31c8934ba90 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.373138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558ed1-daa1-4709-ab38-e31c8934ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.418781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0e558ed1-daa1-4709-ab38-e31c8934ba90 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:48.423060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0e558ed1-daa1-4709-ab38-e31c8934ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:48.431060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 926/1872] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:48.434556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866390e-3e77-4d3e-9100-d114f5e1cf69 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.454143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 947/1873] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:48.459624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866390e-3e77-4d3e-9100-d114f5e1cf69 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.461609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558ed1-daa1-4709-ab38-e31c8934ba90 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.466981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.467901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.468376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.468882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.469821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.472682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.505208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 927/1874] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:48 2022] POST /identity/v3/users => generated 293 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:48.506800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558ed1-daa1-4709-ab38-e31c8934ba90 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.508082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.524811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.525506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.525799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.526151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.526819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:48.527002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf80ff-6f1c-4b9a-819f-cbe0b829dfe8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.527475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.528856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.536319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.537755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.538286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.538805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.540053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.541942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.562552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 928/1875] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:48.564660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.574629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 948/1876] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:48.579023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.584641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb206-ec8f-44ea-b8d0-5c57478cccdb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.595630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.596601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3051-9cd3-4b88-bcb7-732f3c16cf38 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.597633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.598072 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.598505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.601111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.604400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.610916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.611772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.612613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.612902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.613618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.615684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.630755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 929/1877] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:01:48.633651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.646936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462f0f-7682-44ce-8cb8-1fed97e1d5c5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.653292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04e038-f1ff-4c95-b0c2-397de7ff7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.654538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e038-f1ff-4c95-b0c2-397de7ff7b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.655085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e038-f1ff-4c95-b0c2-397de7ff7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.655452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e038-f1ff-4c95-b0c2-397de7ff7b73 admin admin] PATH_INFO: `/v3/projects/97ffd47f9ed34e9286ceedeb1e11ed07/users/2adb89b24d99432882d5870bcec25266/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.677565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04e038-f1ff-4c95-b0c2-397de7ff7b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ffd47f9ed34e9286ceedeb1e11ed07, user_id=2adb89b24d99432882d5870bcec25266, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.681526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04e038-f1ff-4c95-b0c2-397de7ff7b73 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:48.682945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 949/1878] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:48 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:01:48.697086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.714898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 930/1879] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:48 2022] PUT /identity/v3/projects/97ffd47f9ed34e9286ceedeb1e11ed07/users/2adb89b24d99432882d5870bcec25266/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:48.716746 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69df55-4ced-4538-ab97-59e34fb2ad09 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.717424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69df55-4ced-4538-ab97-59e34fb2ad09 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.717715 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69df55-4ced-4538-ab97-59e34fb2ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.796171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fe69df55-4ced-4538-ab97-59e34fb2ad09 None None] MFA Rules not processed for user `2adb89b24d99432882d5870bcec25266`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:48.798518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe69df55-4ced-4538-ab97-59e34fb2ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:48.822919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:48.871548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac455f-c99d-4ac8-8366-bb32a71436bc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:48.951638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 931/1880] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:48.951638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5fca-f583-4af4-87c3-1c064b8828e5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.951638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5fca-f583-4af4-87c3-1c064b8828e5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.951638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5fca-f583-4af4-87c3-1c064b8828e5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.953911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 932/1881] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:01:48.963323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5fca-f583-4af4-87c3-1c064b8828e5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:48.967679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1717e-6192-4817-a5c4-d63b91747b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:48.968222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4df5fca-f583-4af4-87c3-1c064b8828e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:48.968440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1717e-6192-4817-a5c4-d63b91747b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:48.968699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1717e-6192-4817-a5c4-d63b91747b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:48.968979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1717e-6192-4817-a5c4-d63b91747b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:48.969874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1717e-6192-4817-a5c4-d63b91747b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:48.973041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1717e-6192-4817-a5c4-d63b91747b74 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.020129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 950/1882] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:48 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:49.023605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747fdcc-d936-4459-af8a-b293ed46bba9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.023921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747fdcc-d936-4459-af8a-b293ed46bba9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.025348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747fdcc-d936-4459-af8a-b293ed46bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.073092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b747fdcc-d936-4459-af8a-b293ed46bba9 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:49.074766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b747fdcc-d936-4459-af8a-b293ed46bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.097016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5fca-f583-4af4-87c3-1c064b8828e5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.101803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.103307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.103834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.104350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.119402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.122643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.128401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:49.137708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 933/1883] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:01:49.138921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.156382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8eae-9766-4536-b83d-6ecdd3cf8051 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.173998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.175294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.175598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.175868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.176659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.178288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.192613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 934/1884] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:49.192613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.194569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.198511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 951/1885] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:49.199518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747fdcc-d936-4459-af8a-b293ed46bba9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.212994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747fdcc-d936-4459-af8a-b293ed46bba9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.214608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef34d5-bc69-494b-a1c4-419033c5ee61 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.218234 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.219200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.220092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.220386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] PATH_INFO: `/v3/users/2adb89b24d99432882d5870bcec25266` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.232354 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.232567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adb89b24d99432882d5870bcec25266)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.233031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.233322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.234768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.234946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.250535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.253808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.287239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 935/1886] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:49.289135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.309868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b725bca-fe7f-4b08-ac64-5432bcbedab4 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.319745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.319745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.320205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.320359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.321288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.328889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.329523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adb89b24d99432882d5870bcec25266'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:49.340998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:49.356491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 936/1887] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:49.357727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.361192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adb89b24d99432882d5870bcec25266'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:49.379838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adb89b24d99432882d5870bcec25266'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:49.381018 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c14df4-08f4-4508-a417-d3c310372810 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.392928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adb89b24d99432882d5870bcec25266'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:49.394693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0539f226-9955-4696-ad5d-05cff753001f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adb89b24d99432882d5870bcec25266'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:49.396063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dedb2-260e-48de-9bb7-8aa1fb8f8955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.396981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dedb2-260e-48de-9bb7-8aa1fb8f8955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.397265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dedb2-260e-48de-9bb7-8aa1fb8f8955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.397550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dedb2-260e-48de-9bb7-8aa1fb8f8955 admin admin] PATH_INFO: `/v3/projects/66c84930bae34b6b996fea74f9f8c584/users/b4227739e3c448ae8df63025d15d9e3c/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.407265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 952/1888] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:49 2022] DELETE /identity/v3/users/2adb89b24d99432882d5870bcec25266 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:49.413934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.413934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.413934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.434323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dedb2-260e-48de-9bb7-8aa1fb8f8955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c84930bae34b6b996fea74f9f8c584, user_id=b4227739e3c448ae8df63025d15d9e3c, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.437065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dedb2-260e-48de-9bb7-8aa1fb8f8955 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.447449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:49.448777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.464142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 937/1889] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:49 2022] PUT /identity/v3/projects/66c84930bae34b6b996fea74f9f8c584/users/b4227739e3c448ae8df63025d15d9e3c/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:49.472107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.472898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.473389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.514908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] MFA Rules not processed for user `b4227739e3c448ae8df63025d15d9e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:49.516782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.568165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 953/1890] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:49.568165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.568165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.615337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 938/1891] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:49.616422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.621252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.670921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf5fd-48c1-4e88-b529-3ab6c7b578b2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.679332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.679907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.680347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.680631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.682859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.697559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.699177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.709225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4535ba-934f-483d-9a57-19199b77fc14 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.714014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 954/1892] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:49.715129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:49.716431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.716742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:49.717562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.720076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.721813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.746121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.748069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.780492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 939/1893] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:49.822084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5927f-4337-4268-bdf3-b043dfb1bc63 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:49.827356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:49.828133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:49.828491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:49.828847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:49.839383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:49.841001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:49.852983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:49.870027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 955/1894] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:50.485523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:50.487730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:50.513784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed556a-8ab5-48f1-99a6-a7d1c40e072a service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:50.529766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:50.531681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:50.532213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:50.532954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] PATH_INFO: `/v3/projects/4ab38b001ed84de2bc40e7902d86505e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:50.537401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab38b001ed84de2bc40e7902d86505e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:50.540566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:50.626618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:50.662510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab38b001ed84de2bc40e7902d86505e', 'request_id': 'req-0d2a237e-a0ed-4271-86b1-817ba0072b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:50.691472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab38b001ed84de2bc40e7902d86505e', 'request_id': 'req-0d2a237e-a0ed-4271-86b1-817ba0072b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:50.706549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab38b001ed84de2bc40e7902d86505e', 'request_id': 'req-0d2a237e-a0ed-4271-86b1-817ba0072b97'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:50.723840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] The token cache is being invalidate because project 4ab38b001ed84de2bc40e7902d86505e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:50.727770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:50.728961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:50.735602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 940/1895] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:50 2022] DELETE /identity/v3/projects/4ab38b001ed84de2bc40e7902d86505e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:50.739561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:50.771024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44172c1a-73d2-44d9-bb0b-e6245e6563aa service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:50.891291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:50.892438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:50.893878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:50.894179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] PATH_INFO: `/v3/users/fdc4ea3c3c504cb09412d506b92a4a8c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:50.902063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc4ea3c3c504cb09412d506b92a4a8c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:50.902063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:50.982729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:50.984489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:50.990349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc4ea3c3c504cb09412d506b92a4a8c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.009603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a237e-a0ed-4271-86b1-817ba0072b97 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:51.021353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:51.022791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc4ea3c3c504cb09412d506b92a4a8c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.024282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.024667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.026750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] PATH_INFO: `/v3/projects/97ffd47f9ed34e9286ceedeb1e11ed07` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.031099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ffd47f9ed34e9286ceedeb1e11ed07)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:51.036869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:51.048153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc4ea3c3c504cb09412d506b92a4a8c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.068078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc4ea3c3c504cb09412d506b92a4a8c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.069194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-70dda184-3f92-4d40-823b-2e2bbd2df09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc4ea3c3c504cb09412d506b92a4a8c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.080392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 956/1896] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:50 2022] DELETE /identity/v3/users/fdc4ea3c3c504cb09412d506b92a4a8c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:51.137685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ffd47f9ed34e9286ceedeb1e11ed07', 'request_id': 'req-461b23b0-652b-4862-b578-4affaa31e976'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.146451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ffd47f9ed34e9286ceedeb1e11ed07', 'request_id': 'req-461b23b0-652b-4862-b578-4affaa31e976'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.157154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ffd47f9ed34e9286ceedeb1e11ed07', 'request_id': 'req-461b23b0-652b-4862-b578-4affaa31e976'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.180672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] The token cache is being invalidate because project 97ffd47f9ed34e9286ceedeb1e11ed07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:51.180672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.183549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-461b23b0-652b-4862-b578-4affaa31e976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:51.185675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 941/1897] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:50 2022] DELETE /identity/v3/projects/97ffd47f9ed34e9286ceedeb1e11ed07 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:51.191122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30ab77-5a48-49fd-97c0-aa4f798d68f8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.191435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30ab77-5a48-49fd-97c0-aa4f798d68f8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.192522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30ab77-5a48-49fd-97c0-aa4f798d68f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.213840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4f30ab77-5a48-49fd-97c0-aa4f798d68f8 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:51.215101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4f30ab77-5a48-49fd-97c0-aa4f798d68f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:51.313230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 957/1898] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:01:51.324582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bb1a8-cf3b-40b6-b3b7-a2307011e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.326866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bb1a8-cf3b-40b6-b3b7-a2307011e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.327244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bb1a8-cf3b-40b6-b3b7-a2307011e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.356189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3c0bb1a8-cf3b-40b6-b3b7-a2307011e8f3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:51.357621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c0bb1a8-cf3b-40b6-b3b7-a2307011e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:51.380197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 942/1899] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:51.387794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30ab77-5a48-49fd-97c0-aa4f798d68f8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:51.400341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30ab77-5a48-49fd-97c0-aa4f798d68f8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:51.406537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:51.407560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.407912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.408288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.410089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:51.410823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:51.413363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:51.435832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 958/1900] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:51.436578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bb1a8-cf3b-40b6-b3b7-a2307011e8f3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:51.448840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bb1a8-cf3b-40b6-b3b7-a2307011e8f3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:51.456294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:51.457041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.457333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.457614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.458489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:51.460683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:51.504399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 943/1901] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:51 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:51.506191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:51.523941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22208c8-9f28-4723-b6d2-015832063814 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:51.533092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:51.631526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:51.632859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.633060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.633882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.634709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:51.637369 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:51.667239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 959/1902] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:51 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:51.671605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:51.703349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8a17f-ec12-499e-97b2-8caff4e361f5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:51.719856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:51.720844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.721811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.722156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.723069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:51.728726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:51.770033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 944/1903] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:51.775017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:51.789841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790afa-e20f-46e0-b4e8-b3121366c42a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:51.797264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c208-5ea0-4f26-bdb9-3f8565fb5d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:51.797630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c208-5ea0-4f26-bdb9-3f8565fb5d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.798063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c208-5ea0-4f26-bdb9-3f8565fb5d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.798212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c208-5ea0-4f26-bdb9-3f8565fb5d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.799005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1c208-5ea0-4f26-bdb9-3f8565fb5d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:51.801171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1c208-5ea0-4f26-bdb9-3f8565fb5d1c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:51.841803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 960/1904] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:51.843206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:51.862079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90247fe-5b7c-4065-8d70-392c753a3a4d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:51.868145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:51.869355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.869355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.870037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] PATH_INFO: `/v3/projects/0bc4bb5bd47a4a15beb36ef444bba649/users/88f92e3971b04323a164c65a4f6d7024/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.904627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc4bb5bd47a4a15beb36ef444bba649, user_id=88f92e3971b04323a164c65a4f6d7024, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:51.908183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:51.936606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 945/1905] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:51 2022] PUT /identity/v3/projects/0bc4bb5bd47a4a15beb36ef444bba649/users/88f92e3971b04323a164c65a4f6d7024/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:51.949348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:51.949348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:51.949348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:51.998079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] MFA Rules not processed for user `88f92e3971b04323a164c65a4f6d7024`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:51.999874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:52.125464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 961/1906] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:52.137496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:52.143768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:52.216427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:52.271968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45633f0-3595-4bfb-9330-d9ee7d18d31f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:52.276534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ccf91-223e-496e-8f1f-c7caae2a34de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:52.277654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ccf91-223e-496e-8f1f-c7caae2a34de service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:52.278149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ccf91-223e-496e-8f1f-c7caae2a34de service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:52.278627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ccf91-223e-496e-8f1f-c7caae2a34de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:52.292044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ccf91-223e-496e-8f1f-c7caae2a34de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:52.293622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ccf91-223e-496e-8f1f-c7caae2a34de service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:52.305850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 946/1907] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:52.516966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:52.520293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:52.647067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa0cb6-f1b7-4eae-96c1-e5e730ab6847 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:52.652680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:52.653686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:52.654215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:52.654569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] PATH_INFO: `/v3/projects/1f9f3a8431d940b69ce7beee96f4d16a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:52.656007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9f3a8431d940b69ce7beee96f4d16a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:52.658355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:52.680336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:52.731029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9f3a8431d940b69ce7beee96f4d16a', 'request_id': 'req-5039262c-5c4d-488e-a881-cfa85780dbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:52.766108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9f3a8431d940b69ce7beee96f4d16a', 'request_id': 'req-5039262c-5c4d-488e-a881-cfa85780dbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:52.797147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9f3a8431d940b69ce7beee96f4d16a', 'request_id': 'req-5039262c-5c4d-488e-a881-cfa85780dbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:52.819527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] The token cache is being invalidate because project 1f9f3a8431d940b69ce7beee96f4d16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:52.823916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:52.824726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5039262c-5c4d-488e-a881-cfa85780dbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:52.828601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 962/1908] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:52 2022] DELETE /identity/v3/projects/1f9f3a8431d940b69ce7beee96f4d16a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:52.832485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d856ed-dcd2-4580-9ce9-1455797c8aa1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:52.833039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d856ed-dcd2-4580-9ce9-1455797c8aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:52.833128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d856ed-dcd2-4580-9ce9-1455797c8aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:52.866128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-59d856ed-dcd2-4580-9ce9-1455797c8aa1 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:52.867994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-59d856ed-dcd2-4580-9ce9-1455797c8aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:52.996750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 947/1909] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:53.009740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb543-e718-452b-9cb5-98295a933977 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.010038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb543-e718-452b-9cb5-98295a933977 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.010315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb543-e718-452b-9cb5-98295a933977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.034041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-841eb543-e718-452b-9cb5-98295a933977 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:53.035728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-841eb543-e718-452b-9cb5-98295a933977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:53.048196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 963/1910] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:53.049874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d856ed-dcd2-4580-9ce9-1455797c8aa1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:53.060341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d856ed-dcd2-4580-9ce9-1455797c8aa1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:53.066340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:53.069342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.069653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.069933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.070675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:53.070993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:53.072692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:53.090587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 948/1911] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:01:53.096330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eb543-e718-452b-9cb5-98295a933977 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:53.107286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eb543-e718-452b-9cb5-98295a933977 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:53.126245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:53.126865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.127232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.128209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.130418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:53.132056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:53.180437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 964/1912] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:53 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:53.186687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:53.206271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6988a9-550b-431d-a6d4-a257893b8cbf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:53.323266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:53.324571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.325009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.325481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.326663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:53.329080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:53.369039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 949/1913] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:53 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:53.371907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:53.385510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68387f2-1e40-4efb-b806-fb0ccc362814 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:53.391416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:53.392285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.392636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.393150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.394630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:53.396611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:53.410831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 965/1914] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:53.414785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:53.426964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc84b3-154f-4648-bd67-aa18562b6dc0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:53.433563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1618-0482-4bb7-9d7e-01f4aca65e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:53.434963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1618-0482-4bb7-9d7e-01f4aca65e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.435452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1618-0482-4bb7-9d7e-01f4aca65e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.436203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1618-0482-4bb7-9d7e-01f4aca65e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.437149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1618-0482-4bb7-9d7e-01f4aca65e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:53.439492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1618-0482-4bb7-9d7e-01f4aca65e96 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:53.462013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:53.470014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 950/1915] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:53.477435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6bc4-9dc0-4c1f-8839-7f09f71f5743 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:53.483555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:53.484916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.485295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.485667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] PATH_INFO: `/v3/projects/e968a61a1d824b13b296a354e00d96ae/users/6ea0dee31bdb43368dd9c8601b488b46/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.506389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e968a61a1d824b13b296a354e00d96ae, user_id=6ea0dee31bdb43368dd9c8601b488b46, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:53.510011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:53.544650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bcdc6-a6e9-478f-94d8-6ddc454f9346 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.545338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bcdc6-a6e9-478f-94d8-6ddc454f9346 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.545718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bcdc6-a6e9-478f-94d8-6ddc454f9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.554361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 966/1916] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:53 2022] PUT /identity/v3/projects/e968a61a1d824b13b296a354e00d96ae/users/6ea0dee31bdb43368dd9c8601b488b46/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:53.607174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0b6bcdc6-a6e9-478f-94d8-6ddc454f9346 None None] MFA Rules not processed for user `6ea0dee31bdb43368dd9c8601b488b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:53.611469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0b6bcdc6-a6e9-478f-94d8-6ddc454f9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:53.690784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:53.795888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 951/1917] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:53.800675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:53.920760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7214-6027-420a-bd9c-da19c427421a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:53.928628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:53.929684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:53.930207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:53.930748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:53.931656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:53.935146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:53.984889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 967/1918] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:53 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:53.986458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bcdc6-a6e9-478f-94d8-6ddc454f9346 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:54.006089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bcdc6-a6e9-478f-94d8-6ddc454f9346 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:54.199651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:54.200384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:54.201066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:54.201358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:54.202522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:54.211064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:54.313594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 952/1919] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:53 2022] POST /identity/v3/users => generated 299 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:54.315763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:54.332306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fa3f4-95f8-4335-ab82-4403f6d8653d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:54.350477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:54.350963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:54.352270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:54.354972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:54.355824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:54.362987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:54.389097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 968/1920] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:54.390280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:54.405876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3625f-0374-4677-b6ab-f9a0bb6f608c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:54.421495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:54.423209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:54.428412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:54.429228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] PATH_INFO: `/v3/projects/3abd4bf11edb44c489e126ddbffa1209/users/7560e934413344968637c8e3c1e81182/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:54.464981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abd4bf11edb44c489e126ddbffa1209, user_id=7560e934413344968637c8e3c1e81182, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:54.473890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:54.490726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 953/1921] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:54 2022] PUT /identity/v3/projects/3abd4bf11edb44c489e126ddbffa1209/users/7560e934413344968637c8e3c1e81182/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:54.494824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:54.508811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98e38-36cc-426e-84d5-31af8e5995d1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:54.527917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:54.593490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808e5bc-4858-4c4a-95a1-d15ecc9988d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:54.594167 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808e5bc-4858-4c4a-95a1-d15ecc9988d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:54.594456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808e5bc-4858-4c4a-95a1-d15ecc9988d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:54.594737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808e5bc-4858-4c4a-95a1-d15ecc9988d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:54.595618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808e5bc-4858-4c4a-95a1-d15ecc9988d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:54.597572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808e5bc-4858-4c4a-95a1-d15ecc9988d2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:54.608094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 969/1922] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:54.613421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:54.630376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60725e81-5185-44ad-b935-fab07e5a64a9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:54.631084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:54.631977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:54.632296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:54.632579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] PATH_INFO: `/v3/projects/3abd4bf11edb44c489e126ddbffa1209/users/7560e934413344968637c8e3c1e81182/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:54.634586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abd4bf11edb44c489e126ddbffa1209, user_id=7560e934413344968637c8e3c1e81182, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:54.637297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:54.650053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 954/1923] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:54 2022] PUT /identity/v3/projects/3abd4bf11edb44c489e126ddbffa1209/users/7560e934413344968637c8e3c1e81182/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:54.661517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60332b66-23a0-4bca-80c6-a7f37592f95c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:54.661810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60332b66-23a0-4bca-80c6-a7f37592f95c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:54.662144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60332b66-23a0-4bca-80c6-a7f37592f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:54.690779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-60332b66-23a0-4bca-80c6-a7f37592f95c None None] MFA Rules not processed for user `7560e934413344968637c8e3c1e81182`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:54.692044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60332b66-23a0-4bca-80c6-a7f37592f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:54.782482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 970/1924] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:54.794480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:54.796429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:54.860855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2122-e5eb-4850-b3c8-e1252d4efa5b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:54.866421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29a5ea-7c1a-4c01-8919-583c721f7dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:54.867919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29a5ea-7c1a-4c01-8919-583c721f7dfd service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:54.867919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29a5ea-7c1a-4c01-8919-583c721f7dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:54.868187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29a5ea-7c1a-4c01-8919-583c721f7dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:54.881387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29a5ea-7c1a-4c01-8919-583c721f7dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:54.883195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29a5ea-7c1a-4c01-8919-583c721f7dfd service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:54.895836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 955/1925] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:54.929697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60332b66-23a0-4bca-80c6-a7f37592f95c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:55.001315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60332b66-23a0-4bca-80c6-a7f37592f95c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:55.006590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:55.007462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:55.007753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:55.008062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] PATH_INFO: `/v3/users/6ea0dee31bdb43368dd9c8601b488b46` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:55.009280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea0dee31bdb43368dd9c8601b488b46)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:55.011215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:55.052128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:55.059613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea0dee31bdb43368dd9c8601b488b46'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.073046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea0dee31bdb43368dd9c8601b488b46'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.080126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea0dee31bdb43368dd9c8601b488b46'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.090871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea0dee31bdb43368dd9c8601b488b46'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.091584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea0dee31bdb43368dd9c8601b488b46'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.098417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 971/1926] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:54 2022] DELETE /identity/v3/users/6ea0dee31bdb43368dd9c8601b488b46 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:55.103157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:55.103587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:55.103842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:55.124247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:55.125518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:55.146687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:55.190086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 956/1927] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:55.199054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:55.200475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:55.261303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067c5a3-dc76-4060-8cf4-5d42fe5e5b61 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:55.264945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:55.265620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:55.265902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:55.266173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:55.275959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:55.277414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:55.287519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 972/1928] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:55.618569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:55.620645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:55.639252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72da28-9f6e-4187-af2f-1dd1ceb6b021 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:55.651021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:55.652181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:55.652722 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:55.653647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] PATH_INFO: `/v3/projects/e968a61a1d824b13b296a354e00d96ae` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:55.655114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e968a61a1d824b13b296a354e00d96ae)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:55.658093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:55.716344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e968a61a1d824b13b296a354e00d96ae', 'request_id': 'req-af273d28-7b10-4189-a98d-7156d4b46993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.724471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e968a61a1d824b13b296a354e00d96ae', 'request_id': 'req-af273d28-7b10-4189-a98d-7156d4b46993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.730248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e968a61a1d824b13b296a354e00d96ae', 'request_id': 'req-af273d28-7b10-4189-a98d-7156d4b46993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.741999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] The token cache is being invalidate because project e968a61a1d824b13b296a354e00d96ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:55.742283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.743075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.745066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 957/1929] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:55 2022] DELETE /identity/v3/projects/e968a61a1d824b13b296a354e00d96ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:55.749090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:55.760641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104f555-071b-4a85-95bb-00cc5ff696d5 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:55.823652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:55.824589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:55.824875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:55.825150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] PATH_INFO: `/v3/users/7560e934413344968637c8e3c1e81182` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:55.826327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7560e934413344968637c8e3c1e81182)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:55.828275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:55.874126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7560e934413344968637c8e3c1e81182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.884813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:55.887403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7560e934413344968637c8e3c1e81182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.896767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7560e934413344968637c8e3c1e81182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.904239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7560e934413344968637c8e3c1e81182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.904888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b49ff68b-3a32-42e1-938d-6b6789dcbb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7560e934413344968637c8e3c1e81182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:55.911122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 973/1930] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:55 2022] DELETE /identity/v3/users/7560e934413344968637c8e3c1e81182 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:56.188887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:56.191603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:56.205304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273d28-7b10-4189-a98d-7156d4b46993 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:56.265326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:56.266188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.266473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.266748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] PATH_INFO: `/v3/projects/3abd4bf11edb44c489e126ddbffa1209` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.267976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abd4bf11edb44c489e126ddbffa1209)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:56.269925 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:56.319139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abd4bf11edb44c489e126ddbffa1209', 'request_id': 'req-85c79252-9272-4cad-b6c6-e232e9b7de7a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:56.321647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:56.328494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abd4bf11edb44c489e126ddbffa1209', 'request_id': 'req-85c79252-9272-4cad-b6c6-e232e9b7de7a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:56.335662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abd4bf11edb44c489e126ddbffa1209', 'request_id': 'req-85c79252-9272-4cad-b6c6-e232e9b7de7a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:56.347921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] The token cache is being invalidate because project 3abd4bf11edb44c489e126ddbffa1209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:01:56.348238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:56.348917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-85c79252-9272-4cad-b6c6-e232e9b7de7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:56.350569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 958/1931] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:56 2022] DELETE /identity/v3/projects/3abd4bf11edb44c489e126ddbffa1209 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:56.355346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175bd5-333f-49fd-a2f3-1fbbd3189aad None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.355825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175bd5-333f-49fd-a2f3-1fbbd3189aad None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.355912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175bd5-333f-49fd-a2f3-1fbbd3189aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.375668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-56175bd5-333f-49fd-a2f3-1fbbd3189aad None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:56.376931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56175bd5-333f-49fd-a2f3-1fbbd3189aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:56.443838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 974/1932] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:56.451349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed27ec-1f60-4283-bf31-fa7e3f518564 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.451673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed27ec-1f60-4283-bf31-fa7e3f518564 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.451956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed27ec-1f60-4283-bf31-fa7e3f518564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.470173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-92ed27ec-1f60-4283-bf31-fa7e3f518564 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:56.472177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92ed27ec-1f60-4283-bf31-fa7e3f518564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:56.480047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 959/1933] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:56.484472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175bd5-333f-49fd-a2f3-1fbbd3189aad None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:56.495025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175bd5-333f-49fd-a2f3-1fbbd3189aad None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:56.499642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:56.500351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.500643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.501016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.501720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:01:56.502036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:56.503896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:56.516456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 975/1934] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:01:56.521816 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed27ec-1f60-4283-bf31-fa7e3f518564 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:56.531813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed27ec-1f60-4283-bf31-fa7e3f518564 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:56.537707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:56.538374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.538659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.538935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.539640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:56.541578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:56.570269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 960/1935] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:56 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:01:56.574524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:56.585319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e5550-d03e-48b6-8e93-e3ade60352e6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:56.652313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:56.653004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.653438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.653705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.654412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:56.656393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:56.684444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 976/1936] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:56 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:56.688742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:56.699439 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df28ef-3365-4768-b28b-1ac0e599902a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:56.704025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:56.704707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.704990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.706525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.707267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:56.708890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:56.722058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 961/1937] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:56.724860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:56.735017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3006e7-62e8-4722-afa6-413d22a31346 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:56.740441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab17d-4ebf-4225-ae86-0b8d2adffe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:56.741168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab17d-4ebf-4225-ae86-0b8d2adffe4a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.741763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab17d-4ebf-4225-ae86-0b8d2adffe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.741763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab17d-4ebf-4225-ae86-0b8d2adffe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.742456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab17d-4ebf-4225-ae86-0b8d2adffe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:56.744073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab17d-4ebf-4225-ae86-0b8d2adffe4a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:56.758641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 977/1938] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:56.765011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:56.778388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acefc7-0272-4fd0-a7c6-69e5f1d2df0d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:56.786016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:56.786016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.786016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.786422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] PATH_INFO: `/v3/projects/4845c2073b36418b82994d21d0083fe0/users/0b595a423cce48d8a435188bc45e0322/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.803481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4845c2073b36418b82994d21d0083fe0, user_id=0b595a423cce48d8a435188bc45e0322, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:56.806283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:56.819479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 962/1939] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:56 2022] PUT /identity/v3/projects/4845c2073b36418b82994d21d0083fe0/users/0b595a423cce48d8a435188bc45e0322/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:56.830089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df01a2-3aa5-4d02-9b30-e19cfdc54f87 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:56.830879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df01a2-3aa5-4d02-9b30-e19cfdc54f87 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:56.831787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df01a2-3aa5-4d02-9b30-e19cfdc54f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:56.862335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-12df01a2-3aa5-4d02-9b30-e19cfdc54f87 None None] MFA Rules not processed for user `0b595a423cce48d8a435188bc45e0322`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:56.863602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-12df01a2-3aa5-4d02-9b30-e19cfdc54f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:56.898487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:56.949090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 978/1940] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:56.953795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.035251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492d329-16eb-491e-9b30-f6f25fec8be1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.039990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.040711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.041001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.041282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.041986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.043912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.070973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 963/1941] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:56 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:57.084341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df01a2-3aa5-4d02-9b30-e19cfdc54f87 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.095840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df01a2-3aa5-4d02-9b30-e19cfdc54f87 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.159639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.160399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.160707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.161023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.161758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.163810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.190761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 979/1942] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:57 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:57.193181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.206308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79c9d7-25a3-418f-900f-8e5070746441 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.212413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.213293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.213732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.214602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.215502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.217858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.231730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 964/1943] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:57.234782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.246863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0723c-aab0-4c32-8c59-4e79e30e1bb5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.253507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c87a2-821f-4cf0-9092-820f0f5616e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.254808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c87a2-821f-4cf0-9092-820f0f5616e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.254808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c87a2-821f-4cf0-9092-820f0f5616e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.254808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c87a2-821f-4cf0-9092-820f0f5616e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.255487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c87a2-821f-4cf0-9092-820f0f5616e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.257353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c87a2-821f-4cf0-9092-820f0f5616e9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.268962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 980/1944] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:57.273950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.284490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc52ff-12f3-4347-a4f1-e1a6a317928c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.289832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.290685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.290983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.291251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] PATH_INFO: `/v3/projects/d01a6036d02847c1826964e23e92c856/users/7063e2e13ad1414d85a59c6fe2fd4732/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.310298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01a6036d02847c1826964e23e92c856, user_id=7063e2e13ad1414d85a59c6fe2fd4732, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.315100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.337238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 965/1945] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:57 2022] PUT /identity/v3/projects/d01a6036d02847c1826964e23e92c856/users/7063e2e13ad1414d85a59c6fe2fd4732/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:57.351203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a12dc8-5b20-435d-b449-19cd8bc46adb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.352060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a12dc8-5b20-435d-b449-19cd8bc46adb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.352827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a12dc8-5b20-435d-b449-19cd8bc46adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.388892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-24a12dc8-5b20-435d-b449-19cd8bc46adb None None] MFA Rules not processed for user `7063e2e13ad1414d85a59c6fe2fd4732`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:57.391243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-24a12dc8-5b20-435d-b449-19cd8bc46adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:57.503876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 981/1946] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:57.504398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.546088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:57.605426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579bab-5159-4442-9dbb-61b361d2ad12 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.612474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.613865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.614262 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.614776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.615760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.618361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.660204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 966/1947] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:01:57 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:57.662994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a12dc8-5b20-435d-b449-19cd8bc46adb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.680706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a12dc8-5b20-435d-b449-19cd8bc46adb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.753667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:57.781577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.782339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.782633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.784756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.785540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.789232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.829786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 982/1948] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:01:57 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:01:57.831443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.844410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81033b-dbec-4b1c-99f9-2d966895a54a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.852428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.853479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.854031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.854837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.855801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.857900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.874217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 967/1949] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:01:57.880559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.892751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50ce3-f70a-425b-bcd6-051f110188c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:57.909330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:57.910701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:57.910995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:57.911277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] PATH_INFO: `/v3/projects/d6cb72cb87b74eb7b2d8e6e60fcda7b1/users/510ec25410e443f59da3e32ab8885110/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:57.948147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cb72cb87b74eb7b2d8e6e60fcda7b1, user_id=510ec25410e443f59da3e32ab8885110, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:57.951218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:57.971375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 983/1950] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:57 2022] PUT /identity/v3/projects/d6cb72cb87b74eb7b2d8e6e60fcda7b1/users/510ec25410e443f59da3e32ab8885110/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:01:57.975738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:57.989086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93d3c-5e04-438b-8e43-0690d3d756f9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:58.074787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da30d84-bdd9-4f7d-b490-a5fd0d179644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:58.076068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30d84-bdd9-4f7d-b490-a5fd0d179644 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:58.077067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30d84-bdd9-4f7d-b490-a5fd0d179644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:58.077826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30d84-bdd9-4f7d-b490-a5fd0d179644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:58.079292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da30d84-bdd9-4f7d-b490-a5fd0d179644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:58.091730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da30d84-bdd9-4f7d-b490-a5fd0d179644 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:58.105129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 968/1951] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:01:58.110939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:58.128503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25495a4a-aa21-411e-a49d-a21c3a435c20 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:58.133822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:58.135412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:58.135699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:58.135979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] PATH_INFO: `/v3/projects/d6cb72cb87b74eb7b2d8e6e60fcda7b1/users/510ec25410e443f59da3e32ab8885110/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:58.138069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cb72cb87b74eb7b2d8e6e60fcda7b1, user_id=510ec25410e443f59da3e32ab8885110, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:58.140943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:58.168332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 984/1952] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:01:58 2022] PUT /identity/v3/projects/d6cb72cb87b74eb7b2d8e6e60fcda7b1/users/510ec25410e443f59da3e32ab8885110/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:58.178666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:58.178956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:58.179845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:58.210010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] MFA Rules not processed for user `510ec25410e443f59da3e32ab8885110`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:58.211704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:58.303130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 969/1953] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:58.313907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:58.315805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:58.376471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0a70-f3f4-422e-a84d-0628cdabded6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:58.380669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:58.381321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:58.381647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:58.381933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:58.392008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:58.394140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:58.404775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 985/1954] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:58.929064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:58.930608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:58.966375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:58.983128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:58.993844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc83d5-681b-44e5-94e9-7f9d9be99485 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:58.998007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fb2e1-2dff-478a-aacc-54f0f21076f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:58.998722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb2e1-2dff-478a-aacc-54f0f21076f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:58.999216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb2e1-2dff-478a-aacc-54f0f21076f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:58.999518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb2e1-2dff-478a-aacc-54f0f21076f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:59.024855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e8709-1a9f-4569-841c-bf1a2777e214 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:59.033831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:59.034949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:59.035130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:59.035441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] PATH_INFO: `/v3/users/2e4ab0f8d1354862b6ac8c726d621e9b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:59.037653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4ab0f8d1354862b6ac8c726d621e9b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:59.040385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:59.084029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fb2e1-2dff-478a-aacc-54f0f21076f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:59.085820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fb2e1-2dff-478a-aacc-54f0f21076f6 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:59.101364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 986/1955] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:01:59.119243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4ab0f8d1354862b6ac8c726d621e9b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:59.132091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4ab0f8d1354862b6ac8c726d621e9b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:59.133662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4ab0f8d1354862b6ac8c726d621e9b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:59.134414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4ab0f8d1354862b6ac8c726d621e9b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:59.153090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4ab0f8d1354862b6ac8c726d621e9b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:01:59.178212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 970/1956] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:01:58 2022] DELETE /identity/v3/users/2e4ab0f8d1354862b6ac8c726d621e9b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:01:59.178478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:59.178849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:59.179211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:59.205451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:01:59.207068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:59.279177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:59.349676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 987/1957] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:01:59.361948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:59.373626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:01:59.449031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b06a5-a24f-4bf3-9e75-8802fd4db8d1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:01:59.461235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:01:59.461235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:01:59.461235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:01:59.461235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:01:59.467324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:01:59.469146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:01:59.481563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 971/1958] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:01:59.995465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:01:59.997366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:00.013432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7497d-49d7-48a3-a996-c87dab578c80 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:00.019066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:00.019960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:00.020280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:00.020618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] PATH_INFO: `/v3/projects/aecd1d266a074d04a0efa437f4729323` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:00.021896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecd1d266a074d04a0efa437f4729323)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:00.023775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:00.076253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecd1d266a074d04a0efa437f4729323', 'request_id': 'req-b42fee26-c8b6-4e3f-8843-bcd366656316'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.086795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecd1d266a074d04a0efa437f4729323', 'request_id': 'req-b42fee26-c8b6-4e3f-8843-bcd366656316'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.095804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecd1d266a074d04a0efa437f4729323', 'request_id': 'req-b42fee26-c8b6-4e3f-8843-bcd366656316'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.107143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] The token cache is being invalidate because project aecd1d266a074d04a0efa437f4729323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:00.107435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.108122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.109947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 988/1959] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:01:59 2022] DELETE /identity/v3/projects/aecd1d266a074d04a0efa437f4729323 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:00.114426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:00.124157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8117b-e966-4b0a-befe-0653531ce7bc service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:00.166955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:00.186382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:00.187252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:00.187555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:00.187835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] PATH_INFO: `/v3/users/c7667aa248094ce29176c39b981fd985` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:00.189191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7667aa248094ce29176c39b981fd985)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:00.191773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:00.244306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7667aa248094ce29176c39b981fd985'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.253589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7667aa248094ce29176c39b981fd985'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.254217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7667aa248094ce29176c39b981fd985'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.254851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7667aa248094ce29176c39b981fd985'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.268303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96bbe36e-50f0-4abc-b26e-a16f30933d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7667aa248094ce29176c39b981fd985'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:00.281783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 972/1960] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:00 2022] DELETE /identity/v3/users/c7667aa248094ce29176c39b981fd985 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:00.793651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:00.795892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:00.812245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fee26-c8b6-4e3f-8843-bcd366656316 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:00.914155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:00.915690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:00.916204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:00.916768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] PATH_INFO: `/v3/projects/ff26caea75104b3198e09035faac5c5f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:00.918630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff26caea75104b3198e09035faac5c5f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:00.922207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:00.993658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff26caea75104b3198e09035faac5c5f', 'request_id': 'req-4a64c31a-6e14-4ad1-928a-438b2191061c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:01.002714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff26caea75104b3198e09035faac5c5f', 'request_id': 'req-4a64c31a-6e14-4ad1-928a-438b2191061c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:01.020497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff26caea75104b3198e09035faac5c5f', 'request_id': 'req-4a64c31a-6e14-4ad1-928a-438b2191061c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:01.022387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:01.037194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] The token cache is being invalidate because project ff26caea75104b3198e09035faac5c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:01.037597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:01.038368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4a64c31a-6e14-4ad1-928a-438b2191061c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:01.040337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 989/1961] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:00 2022] DELETE /identity/v3/projects/ff26caea75104b3198e09035faac5c5f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:01.046347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db9dfa-e01c-4dd0-9e5d-ca8be56e5661 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.046817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db9dfa-e01c-4dd0-9e5d-ca8be56e5661 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.047206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db9dfa-e01c-4dd0-9e5d-ca8be56e5661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.072351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b6db9dfa-e01c-4dd0-9e5d-ca8be56e5661 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:01.073586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b6db9dfa-e01c-4dd0-9e5d-ca8be56e5661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:01.162630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 973/1962] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:01.172303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb33b9-9828-4b80-b6fb-41026c586ba3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.172653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb33b9-9828-4b80-b6fb-41026c586ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.173079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb33b9-9828-4b80-b6fb-41026c586ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.197937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c7fb33b9-9828-4b80-b6fb-41026c586ba3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:01.199466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c7fb33b9-9828-4b80-b6fb-41026c586ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:01.210349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 990/1963] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:01.215625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db9dfa-e01c-4dd0-9e5d-ca8be56e5661 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:01.227460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db9dfa-e01c-4dd0-9e5d-ca8be56e5661 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:01.232744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:01.233454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.234344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.234563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.235336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:01.235641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:01.237951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:01.251437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 974/1964] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:02:01.256328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb33b9-9828-4b80-b6fb-41026c586ba3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:01.269464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb33b9-9828-4b80-b6fb-41026c586ba3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:01.276099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:01.278737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.279044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.279411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.282457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:01.286942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:01.321969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 991/1965] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:01 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:01.326281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:01.339172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ae391-1f0b-4813-a539-fdbd49ac2403 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:01.396660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:01.412781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:01.413753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.414039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.414467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.415305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:01.418058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:01.447606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 975/1966] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:01 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:01.449241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:01.461201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3de39-55c7-4ef4-9790-728dd8a15452 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:01.476908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:01.477638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.477935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.479260 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.479260 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:01.480724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:01.493411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 992/1967] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:01.496840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:01.513003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926b7d-e6dd-496f-971e-0742b49d1cfa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:01.520288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86b95-7c1f-4b11-9e46-32c72731e06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:01.521430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86b95-7c1f-4b11-9e46-32c72731e06e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.522438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86b95-7c1f-4b11-9e46-32c72731e06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.522787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86b95-7c1f-4b11-9e46-32c72731e06e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.525413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c86b95-7c1f-4b11-9e46-32c72731e06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:01.527495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c86b95-7c1f-4b11-9e46-32c72731e06e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:01.545207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 976/1968] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:01.551559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:01.572643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0910c-ea7f-4574-9933-4785027f574b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:01.583038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:01.584287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.584479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.584762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] PATH_INFO: `/v3/projects/cb4ea3dabfb143118f7cb75596a44cb4/users/8df758d726af495094b9a00080b8ad42/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.602358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4ea3dabfb143118f7cb75596a44cb4, user_id=8df758d726af495094b9a00080b8ad42, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:01.606210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:01.623321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 993/1969] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:01 2022] PUT /identity/v3/projects/cb4ea3dabfb143118f7cb75596a44cb4/users/8df758d726af495094b9a00080b8ad42/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:01.635849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c24854-f75f-44a7-9632-288fd28c6b9c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.636208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c24854-f75f-44a7-9632-288fd28c6b9c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.636521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c24854-f75f-44a7-9632-288fd28c6b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.678591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f0c24854-f75f-44a7-9632-288fd28c6b9c None None] MFA Rules not processed for user `8df758d726af495094b9a00080b8ad42`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:01.680510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f0c24854-f75f-44a7-9632-288fd28c6b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:01.803128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 977/1970] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:01.807780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:01.941085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4081a-f6a4-4575-ae41-97263e877181 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:01.948934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:01.949955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:01.950476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:01.951089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:01.952504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:01.955258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:02.012074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 994/1971] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:01 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:02.015833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c24854-f75f-44a7-9632-288fd28c6b9c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:02.045092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c24854-f75f-44a7-9632-288fd28c6b9c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:02.168801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:02.169449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:02.169875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:02.170202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:02.171010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:02.173392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:02.215317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 978/1972] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:02 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:02.217567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:02.250465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c019-67ef-4048-aafb-ad530d1d8ba9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:02.261421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:02.262211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:02.262597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:02.262992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:02.263839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:02.265695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:02.284087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 995/1973] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:02.285789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:02.300904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac5e62-57fa-4791-acfe-fb9c4f896263 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:02.307514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:02.308718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:02.309530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:02.309918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] PATH_INFO: `/v3/projects/33341e108e3749348c7f43ab9eddcea8/users/c1e3058d58974a30a3db7dbf6457e449/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:02.329822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33341e108e3749348c7f43ab9eddcea8, user_id=c1e3058d58974a30a3db7dbf6457e449, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:02.333351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:02.353835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 979/1974] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:02 2022] PUT /identity/v3/projects/33341e108e3749348c7f43ab9eddcea8/users/c1e3058d58974a30a3db7dbf6457e449/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:02.355113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:02.374294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3598732-191d-4695-8598-7f12cc0cc926 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:02.498394 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b014c-f6ad-4f80-8c9e-82725626f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:02.499446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b014c-f6ad-4f80-8c9e-82725626f826 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:02.499958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b014c-f6ad-4f80-8c9e-82725626f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:02.500657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b014c-f6ad-4f80-8c9e-82725626f826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:02.501206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b014c-f6ad-4f80-8c9e-82725626f826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:02.504428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b014c-f6ad-4f80-8c9e-82725626f826 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:02.507927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:02.526145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 996/1975] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:02.529023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:02.557347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53189-97ac-419c-a063-24a7ab4d8e90 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:02.567626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:02.568826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:02.569180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:02.569735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] PATH_INFO: `/v3/projects/33341e108e3749348c7f43ab9eddcea8/users/c1e3058d58974a30a3db7dbf6457e449/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:02.572613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33341e108e3749348c7f43ab9eddcea8, user_id=c1e3058d58974a30a3db7dbf6457e449, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:02.576556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:02.601500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 980/1976] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:02 2022] PUT /identity/v3/projects/33341e108e3749348c7f43ab9eddcea8/users/c1e3058d58974a30a3db7dbf6457e449/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:02.610721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007dd27-ff6a-4bd8-8379-c74393519ca8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:02.611392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007dd27-ff6a-4bd8-8379-c74393519ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:02.612183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007dd27-ff6a-4bd8-8379-c74393519ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:02.646278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5007dd27-ff6a-4bd8-8379-c74393519ca8 None None] MFA Rules not processed for user `c1e3058d58974a30a3db7dbf6457e449`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:02.648207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5007dd27-ff6a-4bd8-8379-c74393519ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:02.750232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 997/1977] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:02.770594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:02.772847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:02.790654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:02.901497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f71c8-8238-4388-94a0-a1da89b9eec6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:02.906055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:02.906835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:02.907239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:02.907592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:03.006474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:03.008950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:03.020536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 981/1978] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:05.245001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007dd27-ff6a-4bd8-8379-c74393519ca8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:05.257597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007dd27-ff6a-4bd8-8379-c74393519ca8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:05.262422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e0d5-8140-4b87-a195-e9eb0350efec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:05.263386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e0d5-8140-4b87-a195-e9eb0350efec service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:05.263903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e0d5-8140-4b87-a195-e9eb0350efec service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:05.264335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e0d5-8140-4b87-a195-e9eb0350efec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:05.266358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2191e0d5-8140-4b87-a195-e9eb0350efec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:05.367513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191e0d5-8140-4b87-a195-e9eb0350efec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:05.369003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191e0d5-8140-4b87-a195-e9eb0350efec service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:05.382189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 998/1979] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:11.500975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:11.661455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6112ec-1b91-4f80-8442-0be41a80a378 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:11.670362 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:11.671732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:11.676353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:11.678571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] PATH_INFO: `/v3/users/8df758d726af495094b9a00080b8ad42` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:11.680397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df758d726af495094b9a00080b8ad42)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:11.682615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:11.790374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df758d726af495094b9a00080b8ad42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:11.801702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df758d726af495094b9a00080b8ad42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:11.802667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df758d726af495094b9a00080b8ad42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:11.803502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df758d726af495094b9a00080b8ad42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:11.819979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:11.824008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df758d726af495094b9a00080b8ad42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:11.842975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 982/1980] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:11 2022] DELETE /identity/v3/users/8df758d726af495094b9a00080b8ad42 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:11.848092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:11.848630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:11.848796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:11.867388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:11.868767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:11.959200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 999/1981] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:11.969516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:11.971833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:12.070753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4a9d-f263-4156-aa5b-6ac2d2a11c91 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:12.088003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:12.088890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:12.089250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:12.089636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:12.117013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:12.118501 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:12.134857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 983/1982] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:12.536894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:12.538437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:12.552933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ddd38-eb02-4e0b-a9c1-4b485daf23dd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:12.558576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:12.559810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:12.560277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:12.560722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] PATH_INFO: `/v3/projects/cb4ea3dabfb143118f7cb75596a44cb4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:12.562311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4ea3dabfb143118f7cb75596a44cb4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:12.566437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:12.591595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:12.607727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:12.611854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:12.655145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9782cae-6766-4e41-a073-e1e8a133acb4 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:12.665852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:12.669105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:12.670253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:12.670940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] PATH_INFO: `/v3/users/0b595a423cce48d8a435188bc45e0322` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:12.677352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b595a423cce48d8a435188bc45e0322)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:12.679316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:12.690854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4ea3dabfb143118f7cb75596a44cb4', 'request_id': 'req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.698898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4ea3dabfb143118f7cb75596a44cb4', 'request_id': 'req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.708541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4ea3dabfb143118f7cb75596a44cb4', 'request_id': 'req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.722357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] The token cache is being invalidate because project cb4ea3dabfb143118f7cb75596a44cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:12.722558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.723444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.725550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1000/1983] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:12 2022] DELETE /identity/v3/projects/cb4ea3dabfb143118f7cb75596a44cb4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:12.729561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:12.731488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:12.756288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b595a423cce48d8a435188bc45e0322'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.774799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b595a423cce48d8a435188bc45e0322'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.775430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b595a423cce48d8a435188bc45e0322'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.776070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b595a423cce48d8a435188bc45e0322'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.790846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0dcdf759-9509-429b-b132-d1992f8dc569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b595a423cce48d8a435188bc45e0322'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.808461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 984/1984] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:12 2022] DELETE /identity/v3/users/0b595a423cce48d8a435188bc45e0322 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:12.815142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e76a44-aa54-4c4e-a9d2-1439e29b2fb2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:12.815603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:12.816113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:12.816848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:12.836851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:12.838654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:12.882726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:12.885169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:12.885845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:12.886472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] PATH_INFO: `/v3/users/c1e3058d58974a30a3db7dbf6457e449` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:12.891480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e3058d58974a30a3db7dbf6457e449)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:12.894961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:12.914587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:12.931356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 985/1985] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:12.942554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:12.944617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:12.966131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e3058d58974a30a3db7dbf6457e449'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.971713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:12.986793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e3058d58974a30a3db7dbf6457e449'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:12.996980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e3058d58974a30a3db7dbf6457e449'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.009555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e3058d58974a30a3db7dbf6457e449'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.010412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e3058d58974a30a3db7dbf6457e449'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.019192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1001/1986] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:12 2022] DELETE /identity/v3/users/c1e3058d58974a30a3db7dbf6457e449 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:13.020691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fce0ae-3f32-49ca-8967-46da81cc1049 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:13.081611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88126be0-fd84-486d-882e-2bd4e6cd99bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:13.082363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88126be0-fd84-486d-882e-2bd4e6cd99bb service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:13.082711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88126be0-fd84-486d-882e-2bd4e6cd99bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:13.082995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88126be0-fd84-486d-882e-2bd4e6cd99bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:13.085071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-88126be0-fd84-486d-882e-2bd4e6cd99bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:13.180617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88126be0-fd84-486d-882e-2bd4e6cd99bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:13.182233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88126be0-fd84-486d-882e-2bd4e6cd99bb service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:13.195534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 986/1987] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:02:13.421698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:13.424994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:13.453937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd48e-b156-4954-a5d1-4799ce3a16c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:13.461400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:13.465403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:13.465991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:13.468512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] PATH_INFO: `/v3/projects/33341e108e3749348c7f43ab9eddcea8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:13.471350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33341e108e3749348c7f43ab9eddcea8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:13.474223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:13.560491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33341e108e3749348c7f43ab9eddcea8', 'request_id': 'req-de3bf622-0644-4440-bfe4-f6565a40f478'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.570427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33341e108e3749348c7f43ab9eddcea8', 'request_id': 'req-de3bf622-0644-4440-bfe4-f6565a40f478'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.579871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33341e108e3749348c7f43ab9eddcea8', 'request_id': 'req-de3bf622-0644-4440-bfe4-f6565a40f478'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.598666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] The token cache is being invalidate because project 33341e108e3749348c7f43ab9eddcea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:13.599106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.599915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-de3bf622-0644-4440-bfe4-f6565a40f478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.609041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1002/1988] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:13 2022] DELETE /identity/v3/projects/33341e108e3749348c7f43ab9eddcea8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:13.613786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:13.614301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:13.614712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:13.665708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:13.667211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:13.764627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 987/1989] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:13.768825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b5fbd-7c40-48e7-9129-8e216a8134a1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:13.769424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b5fbd-7c40-48e7-9129-8e216a8134a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:13.770417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b5fbd-7c40-48e7-9129-8e216a8134a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:13.779572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:13.781073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:13.797814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9d1b5fbd-7c40-48e7-9129-8e216a8134a1 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:13.801970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad9117-7a14-4891-bd47-94de1a01b21b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:13.802098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9d1b5fbd-7c40-48e7-9129-8e216a8134a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:13.807329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:13.808398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:13.808693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:13.808978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] PATH_INFO: `/v3/projects/4845c2073b36418b82994d21d0083fe0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:13.810311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4845c2073b36418b82994d21d0083fe0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:13.812509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:13.813423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1003/1990] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:13.815082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:13.819094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b5fbd-7c40-48e7-9129-8e216a8134a1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:13.831205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b5fbd-7c40-48e7-9129-8e216a8134a1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:13.846152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:13.846960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:13.847339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:13.847695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:13.848555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:13.848943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:13.852948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:13.883315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1004/1991] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:02:13.884580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:13.898334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbadc36-b1cf-418c-8d4c-82516436f7f4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:13.900830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4845c2073b36418b82994d21d0083fe0', 'request_id': 'req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.912390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4845c2073b36418b82994d21d0083fe0', 'request_id': 'req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.934772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4845c2073b36418b82994d21d0083fe0', 'request_id': 'req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.953842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] The token cache is being invalidate because project 4845c2073b36418b82994d21d0083fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:13.954139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.956602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:13.961091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 988/1992] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:13 2022] DELETE /identity/v3/projects/4845c2073b36418b82994d21d0083fe0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:13.964918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:13.969062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:13.991935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:13.992784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:13.993071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:13.993352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:13.994066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:13.995984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.030121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1005/1993] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:13 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:14.031368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:14.034055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:14.083603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:14.092993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261415-74ff-4ecd-9ee2-bd2a35d5a03a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.174840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7db64-5b1f-4a57-8a3d-e55ac2cd2b24 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.180592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:14.181527 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.181764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.182037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] PATH_INFO: `/v3/users/7063e2e13ad1414d85a59c6fe2fd4732` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.182597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:14.183403 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.183568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7063e2e13ad1414d85a59c6fe2fd4732)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:14.183876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.184405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.185503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:14.186098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.187846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.227477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1006/1994] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:14 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:14.231894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:14.244395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec8db-748e-46c9-9675-abf59c855db2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.249617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:14.250236 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.250520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.250796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.251576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:14.253031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:14.253250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.261875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7063e2e13ad1414d85a59c6fe2fd4732'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.267878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1007/1995] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:14.272298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7063e2e13ad1414d85a59c6fe2fd4732'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.272847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:14.272967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7063e2e13ad1414d85a59c6fe2fd4732'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.273558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7063e2e13ad1414d85a59c6fe2fd4732'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.274569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:14.287492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7063e2e13ad1414d85a59c6fe2fd4732'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.289133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ff1f0-3447-4fe0-86ef-459ceca3d336 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.295390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396bf3d-e254-4f85-a4d7-0934a55e1244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:14.296136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396bf3d-e254-4f85-a4d7-0934a55e1244 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.296431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396bf3d-e254-4f85-a4d7-0934a55e1244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.296747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396bf3d-e254-4f85-a4d7-0934a55e1244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.297526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396bf3d-e254-4f85-a4d7-0934a55e1244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:14.299432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396bf3d-e254-4f85-a4d7-0934a55e1244 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.302834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 989/1996] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:13 2022] DELETE /identity/v3/users/7063e2e13ad1414d85a59c6fe2fd4732 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:14.313005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1008/1997] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:14.317548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:14.389871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf65bf-736a-4f46-8022-baf62aebea92 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.396577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:14.397473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.397753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.398031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] PATH_INFO: `/v3/projects/3329c5c4af3147b9bedf8ce947d3c06a/users/b86cc45944d84a81a2b6fb5a063c4f40/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.414867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3329c5c4af3147b9bedf8ce947d3c06a, user_id=b86cc45944d84a81a2b6fb5a063c4f40, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:14.417661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.434559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 990/1998] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:14 2022] PUT /identity/v3/projects/3329c5c4af3147b9bedf8ce947d3c06a/users/b86cc45944d84a81a2b6fb5a063c4f40/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:14.447617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.447917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.448288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.477777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] MFA Rules not processed for user `b86cc45944d84a81a2b6fb5a063c4f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:14.479295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:14.597650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1009/1999] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:14.609971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:14.611917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:14.672695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:14.675130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:14.699698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a6568-707f-4c57-a480-f0c157b37d95 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.711154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:14.712462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.713006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.713499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.731637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:14.734079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.755054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 991/2000] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:14.812687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4343ef-600e-4358-b01f-c91a8bb1cc5b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.819281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:14.820249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:14.820543 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:14.820826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] PATH_INFO: `/v3/projects/d01a6036d02847c1826964e23e92c856` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:14.822127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01a6036d02847c1826964e23e92c856)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:14.824108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:14.845836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:14.886067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01a6036d02847c1826964e23e92c856', 'request_id': 'req-13bcd15b-894a-4b0a-a4c1-dad12af12199'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.903725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01a6036d02847c1826964e23e92c856', 'request_id': 'req-13bcd15b-894a-4b0a-a4c1-dad12af12199'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.905078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01a6036d02847c1826964e23e92c856', 'request_id': 'req-13bcd15b-894a-4b0a-a4c1-dad12af12199'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.920772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] The token cache is being invalidate because project d01a6036d02847c1826964e23e92c856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:14.921059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.921710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:14.923471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1010/2001] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:14 2022] DELETE /identity/v3/projects/d01a6036d02847c1826964e23e92c856 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:14.927689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:14.939114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ea716-e25d-4c02-a5d7-9225065e531d service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:14.992831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:15.017863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:15.019068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:15.019544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:15.019838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] PATH_INFO: `/v3/users/510ec25410e443f59da3e32ab8885110` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:15.021319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510ec25410e443f59da3e32ab8885110)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:15.023602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:15.094548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510ec25410e443f59da3e32ab8885110'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.106769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510ec25410e443f59da3e32ab8885110'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.107813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510ec25410e443f59da3e32ab8885110'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.110053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510ec25410e443f59da3e32ab8885110'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.147587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8578635a-780c-4e14-ba67-11bf73f70691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510ec25410e443f59da3e32ab8885110'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.169188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 992/2002] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:14 2022] DELETE /identity/v3/users/510ec25410e443f59da3e32ab8885110 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:15.621116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:15.625487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:15.649799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcd15b-894a-4b0a-a4c1-dad12af12199 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:15.730829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:15.731992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:15.732339 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:15.732609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] PATH_INFO: `/v3/projects/d6cb72cb87b74eb7b2d8e6e60fcda7b1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:15.734360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cb72cb87b74eb7b2d8e6e60fcda7b1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:15.736481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:15.830149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cb72cb87b74eb7b2d8e6e60fcda7b1', 'request_id': 'req-43e5a020-5273-4921-aee5-7c5d95bec948'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.842035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cb72cb87b74eb7b2d8e6e60fcda7b1', 'request_id': 'req-43e5a020-5273-4921-aee5-7c5d95bec948'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.858689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cb72cb87b74eb7b2d8e6e60fcda7b1', 'request_id': 'req-43e5a020-5273-4921-aee5-7c5d95bec948'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.876467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] The token cache is being invalidate because project d6cb72cb87b74eb7b2d8e6e60fcda7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:15.877140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.878149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43e5a020-5273-4921-aee5-7c5d95bec948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:15.880494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1011/2003] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:15 2022] DELETE /identity/v3/projects/d6cb72cb87b74eb7b2d8e6e60fcda7b1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:15.886296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7fadb-8c4a-4853-b3f7-cfd9978df66d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:15.886820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7fadb-8c4a-4853-b3f7-cfd9978df66d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:15.886820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7fadb-8c4a-4853-b3f7-cfd9978df66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:15.906820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cff7fadb-8c4a-4853-b3f7-cfd9978df66d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:15.909422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cff7fadb-8c4a-4853-b3f7-cfd9978df66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:16.005743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 993/2004] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:16.014606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.015517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.015995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.055851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:16.057019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:16.065638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1012/2005] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:16.071361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7fadb-8c4a-4853-b3f7-cfd9978df66d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.083682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7fadb-8c4a-4853-b3f7-cfd9978df66d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.089101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.089782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.090068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.090378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.091128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:16.091470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.093154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.102459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.104064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:16.108796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 994/2006] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:02:16.113563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.117662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989f8eb-18b9-4d33-9209-3e768b47d506 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.122704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.123711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.124004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.124309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] PATH_INFO: `/v3/users/b4227739e3c448ae8df63025d15d9e3c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.124486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc5b67-1477-4e7c-906e-f040e0b0a6ee admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.127305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4227739e3c448ae8df63025d15d9e3c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.131583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.132372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.132596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.132700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.133708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.133906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.136257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.172625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 995/2007] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:16 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:16.173640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:16.174704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.216267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:16.232654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4227739e3c448ae8df63025d15d9e3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:16.268575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4227739e3c448ae8df63025d15d9e3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:16.271101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d3d92-1e40-43a2-8c63-2657e7ec31a3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.276836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.277548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.278317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.278645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.279356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.279789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4227739e3c448ae8df63025d15d9e3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:16.281421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.289968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4227739e3c448ae8df63025d15d9e3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:16.290920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9d292d09-eccf-4af5-86e1-5a92ed2a83a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4227739e3c448ae8df63025d15d9e3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:16.298964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1013/2008] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:16 2022] DELETE /identity/v3/users/b4227739e3c448ae8df63025d15d9e3c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:16.306399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 996/2009] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:16 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:16.306608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.307049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.308172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.310289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.316255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:16.333888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee8f70-a348-4b54-9163-95dff733a496 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.336882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:16.338759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:16.434128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1014/2010] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:16.441384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.443896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:16.493221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.493887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.494169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.494446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.495169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.496929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.507914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 997/2011] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:16.511796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.539444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba13f-6e3c-4ec0-9fb5-649c06c70585 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.553266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.555397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.555692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.555971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.557858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.559497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.564782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45b058-6687-44d3-8f1a-3c2efcac5a42 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.570443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49017719-95e8-4e35-b021-e9cbd4159d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.571409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017719-95e8-4e35-b021-e9cbd4159d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.571780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017719-95e8-4e35-b021-e9cbd4159d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.572164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017719-95e8-4e35-b021-e9cbd4159d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.580707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 998/2012] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:16.581927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:16.585796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49017719-95e8-4e35-b021-e9cbd4159d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.588407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49017719-95e8-4e35-b021-e9cbd4159d2c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.593528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdc04-2585-416f-86eb-b803327d90d4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:16.600189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:16.601030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.601350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.601635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] PATH_INFO: `/v3/projects/8fd9436209104c49a07f39aee7341af4/users/eb61964c15f64e32a960ebc9ea82a6b1/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.605157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1015/2013] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:16.619687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd9436209104c49a07f39aee7341af4, user_id=eb61964c15f64e32a960ebc9ea82a6b1, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:16.622679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:16.642224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 999/2014] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:16 2022] PUT /identity/v3/projects/8fd9436209104c49a07f39aee7341af4/users/eb61964c15f64e32a960ebc9ea82a6b1/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:16.654109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:16.654571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:16.654861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:16.717011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] MFA Rules not processed for user `eb61964c15f64e32a960ebc9ea82a6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:16.718615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:16.851324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:16.945233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1016/2015] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:16.949393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.064589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eb66e-e46c-4d1b-9a6c-b17c72ad9889 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.080003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.080958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.081390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.081774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.082932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.085188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.105710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.108564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:17.134760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ecce-2e3d-427c-99ae-975de7dc2dce None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.134956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1000/2016] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:16 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:17.135841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.141012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:17.209861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.210738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.211028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.211311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] PATH_INFO: `/v3/projects/66c84930bae34b6b996fea74f9f8c584` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.212901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c84930bae34b6b996fea74f9f8c584)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.215233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.228716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b0078-7431-4c40-8bba-34aad90d10b0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.236749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.237426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.237709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.240150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.241263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.243481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.267074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1001/2017] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:17 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:17.271639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.276603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c84930bae34b6b996fea74f9f8c584', 'request_id': 'req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:17.284437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c84930bae34b6b996fea74f9f8c584', 'request_id': 'req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:17.285499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8b739-5e08-44e8-9438-6abdaa774689 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.292079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c84930bae34b6b996fea74f9f8c584', 'request_id': 'req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:17.303220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] The token cache is being invalidate because project 66c84930bae34b6b996fea74f9f8c584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:17.303635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:17.304703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b4f60c8-6897-4de8-a026-3f6ad6fc4703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:17.306595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1017/2018] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:17 2022] DELETE /identity/v3/projects/66c84930bae34b6b996fea74f9f8c584 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:17.317375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21713d-07cd-49a2-8844-2619d52d298f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.317857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21713d-07cd-49a2-8844-2619d52d298f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.318094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21713d-07cd-49a2-8844-2619d52d298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.338324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7b21713d-07cd-49a2-8844-2619d52d298f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:17.339588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b21713d-07cd-49a2-8844-2619d52d298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:17.367902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.368657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.368949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.369227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.369960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.371567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.384257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1002/2019] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:17.387258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.390094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:17.404238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfef3e-e245-4a4b-85f6-7d5904064b99 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.409316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.410380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.410667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.410944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] PATH_INFO: `/v3/projects/befb4815bfb04ac5a796f5a77fcdceed/users/886504a9a1654cda856b96fa4809043c/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.417677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1018/2020] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:17.425516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051df0-adce-44fb-b554-56e0053f85a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.425887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051df0-adce-44fb-b554-56e0053f85a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.426238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051df0-adce-44fb-b554-56e0053f85a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.427414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=befb4815bfb04ac5a796f5a77fcdceed, user_id=886504a9a1654cda856b96fa4809043c, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.431294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.433906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:17.451001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-83051df0-adce-44fb-b554-56e0053f85a9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:17.451280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1003/2021] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:17 2022] PUT /identity/v3/projects/befb4815bfb04ac5a796f5a77fcdceed/users/886504a9a1654cda856b96fa4809043c/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:17.452148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-83051df0-adce-44fb-b554-56e0053f85a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:17.455774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.542771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1019/2022] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:17.546966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884b86-e4fb-4a59-8b3e-598d1b102ba7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.549034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051df0-adce-44fb-b554-56e0053f85a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.554677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.555472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.555871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.556239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.557109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.559006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.559554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051df0-adce-44fb-b554-56e0053f85a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.567175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:17.568202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.569473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.570232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.570758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.571633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:17.572049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.573772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.577072 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1004/2023] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:17.579113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.590207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1020/2024] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:02:17.596055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f4f48-538d-47d8-bfa9-f1e44249dc6d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.597656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.606185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8cc13-6483-40b8-b0a7-2d8d884e09f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.607579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8cc13-6483-40b8-b0a7-2d8d884e09f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.607579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8cc13-6483-40b8-b0a7-2d8d884e09f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.607776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8cc13-6483-40b8-b0a7-2d8d884e09f0 admin admin] PATH_INFO: `/v3/projects/befb4815bfb04ac5a796f5a77fcdceed/users/886504a9a1654cda856b96fa4809043c/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.613045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8cc13-6483-40b8-b0a7-2d8d884e09f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=befb4815bfb04ac5a796f5a77fcdceed, user_id=886504a9a1654cda856b96fa4809043c, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.614158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280aee4-eecd-443c-a33c-d63a930ff2a9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.618845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8cc13-6483-40b8-b0a7-2d8d884e09f0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.625002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.625802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.628607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.629345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.630184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.632216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.635792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1005/2025] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:17 2022] PUT /identity/v3/projects/befb4815bfb04ac5a796f5a77fcdceed/users/886504a9a1654cda856b96fa4809043c/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:17.647592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64ebd-9db5-46d8-b0e8-adf3fab93866 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.658019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64ebd-9db5-46d8-b0e8-adf3fab93866 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.658019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64ebd-9db5-46d8-b0e8-adf3fab93866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.673000 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1021/2026] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:17 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:17.678802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.687878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e0e64ebd-9db5-46d8-b0e8-adf3fab93866 None None] MFA Rules not processed for user `886504a9a1654cda856b96fa4809043c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:17.689286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0e64ebd-9db5-46d8-b0e8-adf3fab93866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:17.758155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94ee98-3597-408d-a9db-fea43e605fee admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.765071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.765799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.766095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.766379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.767638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.769734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.791331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1006/2027] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:17.794064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1022/2028] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:17 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:17.797997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e64ebd-9db5-46d8-b0e8-adf3fab93866 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.798968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.800647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:17.808747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e64ebd-9db5-46d8-b0e8-adf3fab93866 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.815348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.816090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.816361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.816762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.817445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.819267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.831782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1007/2029] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:17.835481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.846310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e7dc5-cdeb-4843-9b76-1402794fe70b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.853039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.854047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.854594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.855442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.856325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.858360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.871019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1008/2030] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:17.874645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed2864-70da-4506-9475-8b0287060acf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.875033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:17.879718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e69c8-24ee-4505-b687-f772854fc43d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.880457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e69c8-24ee-4505-b687-f772854fc43d service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.880745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e69c8-24ee-4505-b687-f772854fc43d service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.881137 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e69c8-24ee-4505-b687-f772854fc43d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.887547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e33a3-f827-4d27-a0a3-cfe74851bdca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:17.894013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e69c8-24ee-4505-b687-f772854fc43d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.895434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:17.895434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.895929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.896980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] PATH_INFO: `/v3/projects/d2b7faadcca14851ae81b92c3421c3c1/users/0316a322e1a04e918abfdcabef53b20c/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.897515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e69c8-24ee-4505-b687-f772854fc43d service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.912311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1023/2031] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:17.917093 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b7faadcca14851ae81b92c3421c3c1, user_id=0316a322e1a04e918abfdcabef53b20c, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:17.919776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:17.941130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1009/2032] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:17 2022] PUT /identity/v3/projects/d2b7faadcca14851ae81b92c3421c3c1/users/0316a322e1a04e918abfdcabef53b20c/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:17.952560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:17.952859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:17.953141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:17.960698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:17.985949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] MFA Rules not processed for user `0316a322e1a04e918abfdcabef53b20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:17.987263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:18.033500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:18.075753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1024/2033] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:18.086553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:18.088332 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:18.101333 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1bb77-1caf-4f71-90f2-abb8ad6effb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:18.106612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32026fc7-674a-400f-945d-abb3fad0abdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:18.107335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026fc7-674a-400f-945d-abb3fad0abdd service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:18.107630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026fc7-674a-400f-945d-abb3fad0abdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:18.107913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026fc7-674a-400f-945d-abb3fad0abdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:18.110114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-32026fc7-674a-400f-945d-abb3fad0abdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:18.165860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:18.166861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a33d1-b5eb-4878-8e9d-d2f1567df218 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:18.176224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:18.176901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:18.177229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:18.177466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:18.187128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32026fc7-674a-400f-945d-abb3fad0abdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:18.187517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:18.188757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32026fc7-674a-400f-945d-abb3fad0abdd service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:18.189079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:18.199450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1025/2034] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:18.199833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1010/2035] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:18.510725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:18.512380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:18.633562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a6fc-1dfd-4362-87c3-58a24ec862a6 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:18.643109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:18.644677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:18.645175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:18.645545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] PATH_INFO: `/v3/users/b86cc45944d84a81a2b6fb5a063c4f40` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:18.647739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86cc45944d84a81a2b6fb5a063c4f40)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:18.651198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:18.712902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:18.723079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86cc45944d84a81a2b6fb5a063c4f40'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:18.738306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86cc45944d84a81a2b6fb5a063c4f40'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:18.747314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86cc45944d84a81a2b6fb5a063c4f40'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:18.764571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86cc45944d84a81a2b6fb5a063c4f40'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:18.765371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86cc45944d84a81a2b6fb5a063c4f40'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:18.772831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1026/2036] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:18 2022] DELETE /identity/v3/users/b86cc45944d84a81a2b6fb5a063c4f40 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:18.777517 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:18.777766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:18.778074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:18.796928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:18.799011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:18.867101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1011/2037] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:18.877047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:18.878605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:18.941868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6795f-cf44-4951-86ec-22d1274c7e6a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:18.946843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a48f3-c458-4af6-842d-4aabea3e17f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:18.947643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a48f3-c458-4af6-842d-4aabea3e17f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:18.947931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a48f3-c458-4af6-842d-4aabea3e17f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:18.948315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a48f3-c458-4af6-842d-4aabea3e17f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:18.958560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a48f3-c458-4af6-842d-4aabea3e17f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:18.960001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a48f3-c458-4af6-842d-4aabea3e17f2 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:18.970568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1027/2038] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:19.539679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:19.545619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:19.567223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83237fe-ce4e-4e69-a194-1cba7569de83 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:19.584513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:19.585612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:19.586378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:19.586664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] PATH_INFO: `/v3/projects/3329c5c4af3147b9bedf8ce947d3c06a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:19.588182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3329c5c4af3147b9bedf8ce947d3c06a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:19.590821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:19.665274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3329c5c4af3147b9bedf8ce947d3c06a', 'request_id': 'req-49422b29-772f-41fb-b059-eb0d06953777'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:19.677967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3329c5c4af3147b9bedf8ce947d3c06a', 'request_id': 'req-49422b29-772f-41fb-b059-eb0d06953777'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:19.687914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3329c5c4af3147b9bedf8ce947d3c06a', 'request_id': 'req-49422b29-772f-41fb-b059-eb0d06953777'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:19.705747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] The token cache is being invalidate because project 3329c5c4af3147b9bedf8ce947d3c06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:19.705952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:19.706821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-49422b29-772f-41fb-b059-eb0d06953777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:19.709859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1012/2039] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:19 2022] DELETE /identity/v3/projects/3329c5c4af3147b9bedf8ce947d3c06a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:19.715102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cae25-8c57-4fdf-963b-799edc30604a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:19.715754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cae25-8c57-4fdf-963b-799edc30604a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:19.715754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cae25-8c57-4fdf-963b-799edc30604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:19.754898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e42cae25-8c57-4fdf-963b-799edc30604a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:19.756178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e42cae25-8c57-4fdf-963b-799edc30604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:19.858542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1028/2040] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:19.868299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8e84b-d223-4709-8897-96f6f3b5afab None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:19.868603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8e84b-d223-4709-8897-96f6f3b5afab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:19.868855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8e84b-d223-4709-8897-96f6f3b5afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:19.893618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-38c8e84b-d223-4709-8897-96f6f3b5afab None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:19.895216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38c8e84b-d223-4709-8897-96f6f3b5afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:19.911232 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1013/2041] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:19.915884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cae25-8c57-4fdf-963b-799edc30604a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:19.929825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cae25-8c57-4fdf-963b-799edc30604a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:19.946533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:19.947345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:19.947635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:19.950793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:19.951776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:19.952164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:19.954881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:19.970826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1029/2042] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:02:19.975807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8e84b-d223-4709-8897-96f6f3b5afab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:19.989706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8e84b-d223-4709-8897-96f6f3b5afab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:19.995026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:19.995845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:19.996171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:19.996460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:19.997174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:19.999144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.029532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1014/2043] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:19 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:20.034604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.052684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3567-0d1a-4ad2-873a-78e62e39a203 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.122282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:20.141562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.142287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.142573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.142856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.143567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.145534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.171994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1030/2044] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:20 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:20.177453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.197698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dee45-ad18-4de4-9bad-48c24e14945c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.203507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.205060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.205366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.215961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.216807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.218498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.233377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1015/2045] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:20.234540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.246453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8835e-899f-4246-b604-dec2a0d4f073 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.252045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad259f-4079-4767-98dc-34c3c0a3ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.253140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad259f-4079-4767-98dc-34c3c0a3ebb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.253140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad259f-4079-4767-98dc-34c3c0a3ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.253390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad259f-4079-4767-98dc-34c3c0a3ebb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.254129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad259f-4079-4767-98dc-34c3c0a3ebb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.255824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad259f-4079-4767-98dc-34c3c0a3ebb1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.266928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1031/2046] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:20.271026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.282255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb64f1-9648-45a0-b179-19e57a0ee694 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.287723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.288808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.289076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.289357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] PATH_INFO: `/v3/projects/468f02c20bb748e0b3ff99991a37be0f/users/414f509ce98c47caad59671a627ae501/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.305515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468f02c20bb748e0b3ff99991a37be0f, user_id=414f509ce98c47caad59671a627ae501, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.308254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.322319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:20.338303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1016/2047] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:20 2022] PUT /identity/v3/projects/468f02c20bb748e0b3ff99991a37be0f/users/414f509ce98c47caad59671a627ae501/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:20.339855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586e53-e3df-463c-a2a8-f83d067cf507 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.340184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586e53-e3df-463c-a2a8-f83d067cf507 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.340473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586e53-e3df-463c-a2a8-f83d067cf507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.374766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-11586e53-e3df-463c-a2a8-f83d067cf507 None None] MFA Rules not processed for user `414f509ce98c47caad59671a627ae501`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:20.378436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-11586e53-e3df-463c-a2a8-f83d067cf507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:20.452567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1032/2048] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:20.456796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.520638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c270e1b-9eeb-47dd-8eb9-eb4be59e5ed5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.526582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.527293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.527584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.527871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.528605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.530611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.564456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1017/2049] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:20 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:20.566325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11586e53-e3df-463c-a2a8-f83d067cf507 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.580557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11586e53-e3df-463c-a2a8-f83d067cf507 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.649880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.650759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.651416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.651853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.653334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.656213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.681202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1033/2050] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:20 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:20.685225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.698067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53a27b-cf68-466e-b326-53512e2d27d8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.704340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.705264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.705559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.705843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.706586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.708290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.721059 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1018/2051] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:20.725652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.739565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edbfb6-14f0-40e7-9442-714fdd100b4f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.748453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101475a-d157-47ff-bb99-ff69a510789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.749146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101475a-d157-47ff-bb99-ff69a510789d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.749442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101475a-d157-47ff-bb99-ff69a510789d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.749716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101475a-d157-47ff-bb99-ff69a510789d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.750461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101475a-d157-47ff-bb99-ff69a510789d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.752396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101475a-d157-47ff-bb99-ff69a510789d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.768315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1034/2052] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:20.772426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:20.783511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0889b-a8fe-4bb4-a123-6183875af72b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:20.788331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:20.789261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.789552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.789832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] PATH_INFO: `/v3/projects/9249706278924621b339f0ad2d39593c/users/24760d7a1a1b420c84a88aa3d8ba5d4f/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.811947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9249706278924621b339f0ad2d39593c, user_id=24760d7a1a1b420c84a88aa3d8ba5d4f, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:20.815969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:20.830518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1019/2053] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:20 2022] PUT /identity/v3/projects/9249706278924621b339f0ad2d39593c/users/24760d7a1a1b420c84a88aa3d8ba5d4f/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:20.841789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4426f5e-885d-48a5-84b6-93c9e3ae6eb1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:20.842086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4426f5e-885d-48a5-84b6-93c9e3ae6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:20.842370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4426f5e-885d-48a5-84b6-93c9e3ae6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:20.870924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d4426f5e-885d-48a5-84b6-93c9e3ae6eb1 None None] MFA Rules not processed for user `24760d7a1a1b420c84a88aa3d8ba5d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:20.872191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d4426f5e-885d-48a5-84b6-93c9e3ae6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:20.892079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:20.944453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1035/2054] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:20.949287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:21.014829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51728-de24-443b-a863-08db4b6970a9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:21.020440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:21.021202 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.021558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.021915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.022761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:21.024678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:21.054331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1020/2055] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:20 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:21.055777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4426f5e-885d-48a5-84b6-93c9e3ae6eb1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:21.067136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4426f5e-885d-48a5-84b6-93c9e3ae6eb1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:21.135903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:21.136622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.136907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.137187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.137883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:21.139796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:21.165372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1036/2056] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:21 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:21.166640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:21.179904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de3db0-35e0-4531-8d39-f5fe5004a98e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:21.186038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:21.186884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.187161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.187505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.190629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:21.191124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:21.208947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1021/2057] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:21.213003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:21.225699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27110cb-5fe5-4e9c-a8af-55a264592b78 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:21.230999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:21.232240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.233384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.233672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] PATH_INFO: `/v3/projects/0af13d65c63a4b2a9d53b723dc6dcd77/users/cce55ab684fc40608e07abe4fcc8d40d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.253077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af13d65c63a4b2a9d53b723dc6dcd77, user_id=cce55ab684fc40608e07abe4fcc8d40d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:21.255784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:21.293973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1037/2058] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:21 2022] PUT /identity/v3/projects/0af13d65c63a4b2a9d53b723dc6dcd77/users/cce55ab684fc40608e07abe4fcc8d40d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:21.294140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:21.304638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde05a1d-eb1b-4b0a-aae1-9778b52dde7a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:21.329802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:21.376951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384bd8-e927-4cd4-aa5a-eedc38310451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:21.377740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384bd8-e927-4cd4-aa5a-eedc38310451 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.378094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384bd8-e927-4cd4-aa5a-eedc38310451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.378446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384bd8-e927-4cd4-aa5a-eedc38310451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.379270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6384bd8-e927-4cd4-aa5a-eedc38310451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:21.381032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6384bd8-e927-4cd4-aa5a-eedc38310451 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:21.396787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1022/2059] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:21.398088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:21.411007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7103b0c-d307-4e10-a346-26904763df69 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:21.419128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:21.420299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.420778 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.421064 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] PATH_INFO: `/v3/projects/0af13d65c63a4b2a9d53b723dc6dcd77/users/cce55ab684fc40608e07abe4fcc8d40d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.423873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af13d65c63a4b2a9d53b723dc6dcd77, user_id=cce55ab684fc40608e07abe4fcc8d40d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:21.426915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:21.438729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1038/2060] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:21 2022] PUT /identity/v3/projects/0af13d65c63a4b2a9d53b723dc6dcd77/users/cce55ab684fc40608e07abe4fcc8d40d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:21.448815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348553ea-e2a3-4665-9817-25450dc2d73d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.449204 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348553ea-e2a3-4665-9817-25450dc2d73d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.449415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348553ea-e2a3-4665-9817-25450dc2d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.480263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-348553ea-e2a3-4665-9817-25450dc2d73d None None] MFA Rules not processed for user `cce55ab684fc40608e07abe4fcc8d40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:21.481910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-348553ea-e2a3-4665-9817-25450dc2d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:21.576062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1023/2061] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:21.588342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:21.590286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:21.671229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e55268-a790-4b1c-be84-4e4a8197e15d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:21.675493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:21.676136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:21.676408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:21.676684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:21.708228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:21.744501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:21.745932 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:21.769643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1039/2062] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:24.479402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348553ea-e2a3-4665-9817-25450dc2d73d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:24.495466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348553ea-e2a3-4665-9817-25450dc2d73d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:24.499550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366253-d0e9-4e12-8242-bf6758b0677b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:24.500296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366253-d0e9-4e12-8242-bf6758b0677b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:24.500625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366253-d0e9-4e12-8242-bf6758b0677b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:24.504248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366253-d0e9-4e12-8242-bf6758b0677b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:24.581720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:24.583210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:24.583618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01366253-d0e9-4e12-8242-bf6758b0677b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:24.585154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01366253-d0e9-4e12-8242-bf6758b0677b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:24.595227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1024/2063] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:24.655609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87077517-79e9-412c-8fcf-f7ec34ce2ff9 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:24.661079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:24.662161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:24.662562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:24.662849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] PATH_INFO: `/v3/users/eb61964c15f64e32a960ebc9ea82a6b1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:24.664437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb61964c15f64e32a960ebc9ea82a6b1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:24.666729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:24.728589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb61964c15f64e32a960ebc9ea82a6b1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:24.741812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb61964c15f64e32a960ebc9ea82a6b1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:24.750088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb61964c15f64e32a960ebc9ea82a6b1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:24.760213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb61964c15f64e32a960ebc9ea82a6b1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:24.761013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb61964c15f64e32a960ebc9ea82a6b1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:24.770523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1040/2064] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:24 2022] DELETE /identity/v3/users/eb61964c15f64e32a960ebc9ea82a6b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:24.776067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:24.776372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:24.776657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:24.794133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:24.795559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:24.841309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:24.864719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1025/2065] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:24.875559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:24.877038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:24.940948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:24.947983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dca6b-0757-4c9d-9a6f-195200647672 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:24.952596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:24.953254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:24.953680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:24.953949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:24.963462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:24.964945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:24.975029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1041/2066] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:25.249224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:25.251297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:25.263756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a45b9-6aeb-4af3-b335-23aecdd23858 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:25.269496 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:25.270364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:25.271254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:25.271254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] PATH_INFO: `/v3/projects/8fd9436209104c49a07f39aee7341af4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:25.272138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd9436209104c49a07f39aee7341af4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:25.274080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:25.321969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd9436209104c49a07f39aee7341af4', 'request_id': 'req-0bfc3e2a-039f-4be6-a84a-28d979a4272d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.330084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd9436209104c49a07f39aee7341af4', 'request_id': 'req-0bfc3e2a-039f-4be6-a84a-28d979a4272d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.335789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd9436209104c49a07f39aee7341af4', 'request_id': 'req-0bfc3e2a-039f-4be6-a84a-28d979a4272d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.347520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] The token cache is being invalidate because project 8fd9436209104c49a07f39aee7341af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:25.347819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.348547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.350096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1026/2067] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:25 2022] DELETE /identity/v3/projects/8fd9436209104c49a07f39aee7341af4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:25.354109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:25.364612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18abd-b5f1-427f-999b-3d5eb80608e9 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:25.423953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:25.424891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:25.425185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:25.425471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] PATH_INFO: `/v3/users/886504a9a1654cda856b96fa4809043c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:25.426777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886504a9a1654cda856b96fa4809043c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:25.428799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:25.483710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886504a9a1654cda856b96fa4809043c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.497974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886504a9a1654cda856b96fa4809043c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.507217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886504a9a1654cda856b96fa4809043c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.515142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886504a9a1654cda856b96fa4809043c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.515867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886504a9a1654cda856b96fa4809043c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:25.522941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1042/2068] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:25 2022] DELETE /identity/v3/users/886504a9a1654cda856b96fa4809043c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:25.922078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:25.924418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:25.952998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3e2a-039f-4be6-a84a-28d979a4272d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:25.974937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:25.976648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:26.023379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.024267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.024944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.024944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] PATH_INFO: `/v3/projects/befb4815bfb04ac5a796f5a77fcdceed` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.026024 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=befb4815bfb04ac5a796f5a77fcdceed)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.028567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.047793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59e136-72ed-48ea-992e-5ca1a344d828 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.051648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11235d65-1e09-4a15-9457-6df58f9aed95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.052481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235d65-1e09-4a15-9457-6df58f9aed95 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.052766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235d65-1e09-4a15-9457-6df58f9aed95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.053049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11235d65-1e09-4a15-9457-6df58f9aed95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.055552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-11235d65-1e09-4a15-9457-6df58f9aed95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:26.080439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:26.085608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befb4815bfb04ac5a796f5a77fcdceed', 'request_id': 'req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:26.097074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befb4815bfb04ac5a796f5a77fcdceed', 'request_id': 'req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:26.104456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befb4815bfb04ac5a796f5a77fcdceed', 'request_id': 'req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:26.113332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:26.119078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] The token cache is being invalidate because project befb4815bfb04ac5a796f5a77fcdceed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:26.119495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:26.120502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3fc97ac4-4a03-459f-b5e4-a45315eb4b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:26.122828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1027/2069] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:25 2022] DELETE /identity/v3/projects/befb4815bfb04ac5a796f5a77fcdceed => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:26.129645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f41f-8fbc-4efd-ad5c-c19122c98c6f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.129976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f41f-8fbc-4efd-ad5c-c19122c98c6f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.130220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f41f-8fbc-4efd-ad5c-c19122c98c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.133401 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11235d65-1e09-4a15-9457-6df58f9aed95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.134862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11235d65-1e09-4a15-9457-6df58f9aed95 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.145072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1043/2070] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:02:26.148876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3af3f41f-8fbc-4efd-ad5c-c19122c98c6f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:26.150075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3af3f41f-8fbc-4efd-ad5c-c19122c98c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:26.216385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1028/2071] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:26.225159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858276-b1c3-4493-b61d-26766dd0479c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.225459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858276-b1c3-4493-b61d-26766dd0479c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.225747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858276-b1c3-4493-b61d-26766dd0479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.248477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3c858276-b1c3-4493-b61d-26766dd0479c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:26.248477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c858276-b1c3-4493-b61d-26766dd0479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:26.254943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1044/2072] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:26.259298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3f41f-8fbc-4efd-ad5c-c19122c98c6f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:26.269319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3f41f-8fbc-4efd-ad5c-c19122c98c6f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.274001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.274653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.274938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.275218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.275947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:26.276290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.277882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.289936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1029/2073] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:02:26.294291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858276-b1c3-4493-b61d-26766dd0479c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:26.305726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858276-b1c3-4493-b61d-26766dd0479c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.310550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.311268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.311657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.311973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.312903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.315893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.341399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1045/2074] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:26 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:26.346500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:26.356941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3957-84e6-48af-8ec1-6abea5d002b7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.416772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.417458 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.417747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.418032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.418776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.420792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.442051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1030/2075] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:26 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:26.446397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:26.457284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e256-a182-4830-ba49-a283ed424051 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.462185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.462857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.463140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.463420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.464214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.465835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.477048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1046/2076] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:26.480957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:26.492110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6a96-e862-48a5-b2c5-aac65755ce10 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.496796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcc80d-ea5f-4f62-b1ad-f61f4d8c88cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.497455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc80d-ea5f-4f62-b1ad-f61f4d8c88cd admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.497741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc80d-ea5f-4f62-b1ad-f61f4d8c88cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.498023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc80d-ea5f-4f62-b1ad-f61f4d8c88cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.498753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcc80d-ea5f-4f62-b1ad-f61f4d8c88cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.500471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcc80d-ea5f-4f62-b1ad-f61f4d8c88cd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.510346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1031/2077] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:26.514421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:26.525012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a9be-6857-4cb0-be80-7b6d3b8d6dec admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.529719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.530601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.530891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.531175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] PATH_INFO: `/v3/projects/77ed35795b1846b386a51d189c6b74d8/users/e28ac85078a141d88d4065d321b68f6e/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.546502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ed35795b1846b386a51d189c6b74d8, user_id=e28ac85078a141d88d4065d321b68f6e, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.550402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.565122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1047/2078] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:26 2022] PUT /identity/v3/projects/77ed35795b1846b386a51d189c6b74d8/users/e28ac85078a141d88d4065d321b68f6e/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:26.575334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.575630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.575913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.605702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] MFA Rules not processed for user `e28ac85078a141d88d4065d321b68f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:26.606826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:26.664917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:26.678785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1032/2079] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:26.691216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:26.693096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:26.756400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23be70-510f-4b27-8f64-b6736d5da7a2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:26.765207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49341f3-c819-4e8a-b846-fc06ca78b677 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:26.767746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49341f3-c819-4e8a-b846-fc06ca78b677 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:26.768062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49341f3-c819-4e8a-b846-fc06ca78b677 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:26.768507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49341f3-c819-4e8a-b846-fc06ca78b677 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:26.780389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49341f3-c819-4e8a-b846-fc06ca78b677 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:26.782590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49341f3-c819-4e8a-b846-fc06ca78b677 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:26.793052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1048/2080] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:34.407304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:34.408781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:34.477258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912b03-7e4e-4240-9bf8-8a3d50d41c3f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:34.482991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:34.483887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:34.484211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:34.485736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] PATH_INFO: `/v3/users/414f509ce98c47caad59671a627ae501` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:34.487033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414f509ce98c47caad59671a627ae501)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:34.489066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:34.538019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414f509ce98c47caad59671a627ae501'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:34.545779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414f509ce98c47caad59671a627ae501'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:34.546464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414f509ce98c47caad59671a627ae501'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:34.547780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414f509ce98c47caad59671a627ae501'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:34.561481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414f509ce98c47caad59671a627ae501'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:34.575359 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1033/2081] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:34 2022] DELETE /identity/v3/users/414f509ce98c47caad59671a627ae501 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:34.580921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:34.581442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:34.581533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:34.605485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:34.605485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:34.681802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:34.695066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1049/2082] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:34.706064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:34.707783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:34.776769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a539c22-a8d8-46e3-99aa-69f22f6b73b2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:34.780548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:34.781781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:34.782184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:34.782618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:34.798503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:34.799880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:34.810032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1034/2083] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:35.119083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:35.120537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:35.135666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a043c5-27df-4662-ad42-9abb7845c387 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:35.150559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:35.151554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:35.151840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:35.152150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] PATH_INFO: `/v3/projects/468f02c20bb748e0b3ff99991a37be0f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:35.153390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=468f02c20bb748e0b3ff99991a37be0f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:35.157099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:35.225420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468f02c20bb748e0b3ff99991a37be0f', 'request_id': 'req-08ebbbee-f060-42f6-8352-9727aae096bd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.232791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468f02c20bb748e0b3ff99991a37be0f', 'request_id': 'req-08ebbbee-f060-42f6-8352-9727aae096bd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.241828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468f02c20bb748e0b3ff99991a37be0f', 'request_id': 'req-08ebbbee-f060-42f6-8352-9727aae096bd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.254045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] The token cache is being invalidate because project 468f02c20bb748e0b3ff99991a37be0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:35.254358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.255087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.257420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1050/2084] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:35 2022] DELETE /identity/v3/projects/468f02c20bb748e0b3ff99991a37be0f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:35.263028 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:35.273603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c34c58-e4e0-453a-ae67-605c39f513b2 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:35.287583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:35.352886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:35.353672 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:35.354042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:35.354277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] PATH_INFO: `/v3/users/24760d7a1a1b420c84a88aa3d8ba5d4f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:35.355636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24760d7a1a1b420c84a88aa3d8ba5d4f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:35.358303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:35.422079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24760d7a1a1b420c84a88aa3d8ba5d4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.432276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24760d7a1a1b420c84a88aa3d8ba5d4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.433006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24760d7a1a1b420c84a88aa3d8ba5d4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.433772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24760d7a1a1b420c84a88aa3d8ba5d4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.449703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24760d7a1a1b420c84a88aa3d8ba5d4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.475548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1035/2085] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:35 2022] DELETE /identity/v3/users/24760d7a1a1b420c84a88aa3d8ba5d4f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:35.811155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:35.814859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:35.852806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebbbee-f060-42f6-8352-9727aae096bd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:35.926952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:35.927843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:35.928162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:35.928473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] PATH_INFO: `/v3/projects/9249706278924621b339f0ad2d39593c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:35.930154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9249706278924621b339f0ad2d39593c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:35.932148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:35.981802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9249706278924621b339f0ad2d39593c', 'request_id': 'req-92bd963c-0200-43a0-9177-5bdb81d534bc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.988661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9249706278924621b339f0ad2d39593c', 'request_id': 'req-92bd963c-0200-43a0-9177-5bdb81d534bc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:35.997475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9249706278924621b339f0ad2d39593c', 'request_id': 'req-92bd963c-0200-43a0-9177-5bdb81d534bc'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.009288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] The token cache is being invalidate because project 9249706278924621b339f0ad2d39593c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:36.009582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.010246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-92bd963c-0200-43a0-9177-5bdb81d534bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.012243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1051/2086] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:35 2022] DELETE /identity/v3/projects/9249706278924621b339f0ad2d39593c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:36.016526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:36.018385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.039567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42327cd4-294a-4e36-b98f-7d43ec1be51c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:36.052728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3df7-9861-4be2-afec-e949be7b25dc None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.053209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3df7-9861-4be2-afec-e949be7b25dc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.053498 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3df7-9861-4be2-afec-e949be7b25dc None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.055372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1052/2087] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:02:36.063182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.063747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.064088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.085966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:36.088140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.098130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:36.113899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:36.115008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.115537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.115730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] PATH_INFO: `/v3/users/cce55ab684fc40608e07abe4fcc8d40d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.117161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce55ab684fc40608e07abe4fcc8d40d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:36.118982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:36.186745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:36.200493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce55ab684fc40608e07abe4fcc8d40d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.202426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1053/2088] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:36.204276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:36.205992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.216054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce55ab684fc40608e07abe4fcc8d40d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.216742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce55ab684fc40608e07abe4fcc8d40d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.217371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce55ab684fc40608e07abe4fcc8d40d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.225209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534351-4c4c-4f0f-9e02-e5361a7bcc90 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:36.230320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:36.231225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.231513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.232090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] PATH_INFO: `/v3/users/9caae6984c3b47c59f8b385af0b40f98` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.233699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9caae6984c3b47c59f8b385af0b40f98)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:36.234661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce55ab684fc40608e07abe4fcc8d40d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.236374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:36.261300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1036/2089] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:36 2022] DELETE /identity/v3/users/cce55ab684fc40608e07abe4fcc8d40d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:36.261300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:36.269718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.297578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9caae6984c3b47c59f8b385af0b40f98'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.324169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9caae6984c3b47c59f8b385af0b40f98'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.340814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9caae6984c3b47c59f8b385af0b40f98'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.358540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9caae6984c3b47c59f8b385af0b40f98'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.367758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9caae6984c3b47c59f8b385af0b40f98'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.392147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1054/2090] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:36 2022] DELETE /identity/v3/users/9caae6984c3b47c59f8b385af0b40f98 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:36.392524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b24c5-60cc-4ba7-a8fe-ddbcc792460c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:36.458839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:36.459503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.459854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.460186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.462032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.477547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:36.479177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:36.491618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1037/2091] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:36.649608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:36.651270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.692214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:36.693712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.752141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a4ccc-0ba6-41c0-b344-4edad2ac8df1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:36.755998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:36.757052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.762457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.762457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] PATH_INFO: `/v3/projects/41aaf61888b149a59ed741d201490e52` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.762457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41aaf61888b149a59ed741d201490e52)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:36.762457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:36.790325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:36.796535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:36.820128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d2816-0745-426e-b66d-75cb7b70fcc5 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:36.824267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41aaf61888b149a59ed741d201490e52', 'request_id': 'req-da044ded-3c66-4018-8d71-9587b33ca2e0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.831140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41aaf61888b149a59ed741d201490e52', 'request_id': 'req-da044ded-3c66-4018-8d71-9587b33ca2e0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.841135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41aaf61888b149a59ed741d201490e52', 'request_id': 'req-da044ded-3c66-4018-8d71-9587b33ca2e0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.853510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] The token cache is being invalidate because project 41aaf61888b149a59ed741d201490e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:36.853806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.854494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-da044ded-3c66-4018-8d71-9587b33ca2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.856146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1055/2092] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:36 2022] DELETE /identity/v3/projects/41aaf61888b149a59ed741d201490e52 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:36.865124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a8d5-4b83-42a8-b3a5-5233a9168dc0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.865466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a8d5-4b83-42a8-b3a5-5233a9168dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.865709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a8d5-4b83-42a8-b3a5-5233a9168dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.889640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-30e8a8d5-4b83-42a8-b3a5-5233a9168dc0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:36.890854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:36.891761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.891874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-30e8a8d5-4b83-42a8-b3a5-5233a9168dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.892159 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.892402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] PATH_INFO: `/v3/projects/0af13d65c63a4b2a9d53b723dc6dcd77` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.893893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af13d65c63a4b2a9d53b723dc6dcd77)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:36.895957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:36.903391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1056/2093] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:36.915141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee91b1-2888-4d70-a29c-093e0eef7378 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:36.915141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee91b1-2888-4d70-a29c-093e0eef7378 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:36.915141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee91b1-2888-4d70-a29c-093e0eef7378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:36.944490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d3ee91b1-2888-4d70-a29c-093e0eef7378 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:36.946036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d3ee91b1-2888-4d70-a29c-093e0eef7378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:36.961978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af13d65c63a4b2a9d53b723dc6dcd77', 'request_id': 'req-f442d19a-8a52-490c-a0d9-fc27d86de017'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.973498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af13d65c63a4b2a9d53b723dc6dcd77', 'request_id': 'req-f442d19a-8a52-490c-a0d9-fc27d86de017'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.982685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af13d65c63a4b2a9d53b723dc6dcd77', 'request_id': 'req-f442d19a-8a52-490c-a0d9-fc27d86de017'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:36.999451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] The token cache is being invalidate because project 0af13d65c63a4b2a9d53b723dc6dcd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:37.000620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:37.000755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f442d19a-8a52-490c-a0d9-fc27d86de017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:37.003865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1038/2094] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:36 2022] DELETE /identity/v3/projects/0af13d65c63a4b2a9d53b723dc6dcd77 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:37.008902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6434-1c4a-4fd6-b09d-bcb596e5aba3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.009830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6434-1c4a-4fd6-b09d-bcb596e5aba3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.010146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6434-1c4a-4fd6-b09d-bcb596e5aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.033324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2eae6434-1c4a-4fd6-b09d-bcb596e5aba3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:37.034572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2eae6434-1c4a-4fd6-b09d-bcb596e5aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:37.036696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1057/2095] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:37.040603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee91b1-2888-4d70-a29c-093e0eef7378 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.043789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1039/2096] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:37.052944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee91b1-2888-4d70-a29c-093e0eef7378 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.053813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365ff38-1d05-41c3-83b5-a81dce85a4d3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.054134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365ff38-1d05-41c3-83b5-a81dce85a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.054417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365ff38-1d05-41c3-83b5-a81dce85a4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.058318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.059062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.059382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.059798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.060609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:37.061133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.063521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.072780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3365ff38-1d05-41c3-83b5-a81dce85a4d3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:37.073989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3365ff38-1d05-41c3-83b5-a81dce85a4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:37.076056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1058/2097] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:02:37.080166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.083318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1040/2098] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:37.087483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365ff38-1d05-41c3-83b5-a81dce85a4d3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.090605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849797e5-fa9e-492e-9331-b9afeb632a73 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.095992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.096700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.096990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.097415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.097575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365ff38-1d05-41c3-83b5-a81dce85a4d3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.098133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.100235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.102195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.102863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.103127 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.103421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.104178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:37.104508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.106083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.119303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1041/2099] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:02:37.123753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.132673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1059/2100] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:37.133773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.134168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd760-461e-4fa9-8c0c-45f7d31f6638 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.190056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:37.197335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749287de-de01-4636-a077-74f5b011feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.198246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749287de-de01-4636-a077-74f5b011feda admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.199046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749287de-de01-4636-a077-74f5b011feda admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.199230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749287de-de01-4636-a077-74f5b011feda admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.200060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749287de-de01-4636-a077-74f5b011feda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.200264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8159c-11dd-42d0-abfb-a484ae9a703b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.203471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749287de-de01-4636-a077-74f5b011feda admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.205825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.206520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.206812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.207099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.207809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.209834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.227698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:37.237728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1042/2101] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:37.237956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1060/2102] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:37.238858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749287de-de01-4636-a077-74f5b011feda admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.240286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.258597 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e5366-b9cf-42b5-ac9f-465be0a8ce96 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.313436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749287de-de01-4636-a077-74f5b011feda admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.318360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.319049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.319334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.319615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.320489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.322491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.324086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.324783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.325098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.325386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.326134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.328530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.339742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1061/2103] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:37.344730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.345877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1043/2104] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:37.350328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.356489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58839f-232d-4b5c-a5c3-5bc8583222ea admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.362897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.363572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.363862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.364173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.364335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c59ea-5346-489a-a0fa-943d13a699bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.364913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.366510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.371619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.372548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.372843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.373124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.373953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.375668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.377166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1062/2105] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:37.381523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.388348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1044/2106] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:37.394097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.394251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e45c1d-a273-4ca7-9d96-510d12a1785e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.398552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a9ba-464f-47ad-85df-7424793302d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.399170 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a9ba-464f-47ad-85df-7424793302d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.400068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a9ba-464f-47ad-85df-7424793302d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.400068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a9ba-464f-47ad-85df-7424793302d8 admin admin] PATH_INFO: `/v3/projects/8920d2de9dc34386bb0e770f5b51b702/users/2691e1dc96e942b5ba4c726b72a835e9/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.411680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc326b-aa73-4742-add7-4a3f16419d6c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.417808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a9ba-464f-47ad-85df-7424793302d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920d2de9dc34386bb0e770f5b51b702, user_id=2691e1dc96e942b5ba4c726b72a835e9, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.418657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.419318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.419607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.419884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.420544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974a9ba-464f-47ad-85df-7424793302d8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.420662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.422258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.439157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1045/2107] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:37.439963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1063/2108] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:37 2022] PUT /identity/v3/projects/8920d2de9dc34386bb0e770f5b51b702/users/2691e1dc96e942b5ba4c726b72a835e9/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:37.440463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.445585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.446941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.447480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.453723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44a11c-27ad-4a82-9f21-9721226effc8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.468408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:37.470499 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:37.528911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b63a-fde1-400f-a038-09fe2205ac05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.529828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b63a-fde1-400f-a038-09fe2205ac05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.530260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b63a-fde1-400f-a038-09fe2205ac05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.530641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b63a-fde1-400f-a038-09fe2205ac05 admin admin] PATH_INFO: `/v3/projects/9fdf6152e6874f78825e5eddb7f14158/users/f8b8f37c287341848d8d3b4d5f62873d/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.541318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1064/2109] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:37.551664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.554442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b63a-fde1-400f-a038-09fe2205ac05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdf6152e6874f78825e5eddb7f14158, user_id=f8b8f37c287341848d8d3b4d5f62873d, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.556910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:37.557827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b63a-fde1-400f-a038-09fe2205ac05 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.573023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1046/2110] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:37 2022] PUT /identity/v3/projects/9fdf6152e6874f78825e5eddb7f14158/users/f8b8f37c287341848d8d3b4d5f62873d/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:37.578617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64da7-f879-4299-a35e-a7662cb78f5f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.578967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64da7-f879-4299-a35e-a7662cb78f5f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.579194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64da7-f879-4299-a35e-a7662cb78f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.597349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e7b64da7-f879-4299-a35e-a7662cb78f5f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:37.598573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e7b64da7-f879-4299-a35e-a7662cb78f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:37.640107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:37.652309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c609e17-88c5-40b0-a3c6-7b50ced689fc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.668908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:37.679099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1047/2111] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:37.688988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b64da7-f879-4299-a35e-a7662cb78f5f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:37.711350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.711928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.712248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.712530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.726255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.727746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.739408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1065/2112] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:37.753189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b64da7-f879-4299-a35e-a7662cb78f5f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:37.757307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771003d2-7f0f-417f-a6dc-98b82fdd7dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:37.758219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771003d2-7f0f-417f-a6dc-98b82fdd7dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:37.758381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771003d2-7f0f-417f-a6dc-98b82fdd7dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:37.758761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771003d2-7f0f-417f-a6dc-98b82fdd7dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:37.772968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771003d2-7f0f-417f-a6dc-98b82fdd7dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:37.774489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771003d2-7f0f-417f-a6dc-98b82fdd7dc6 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:37.785968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1048/2113] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:02:38.063532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:38.065038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:38.078729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355ae93-e407-49ee-ae7c-c8b6bf2f87d1 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:38.084246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:38.085349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:38.085638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:38.085942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] PATH_INFO: `/v3/users/0316a322e1a04e918abfdcabef53b20c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:38.092149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0316a322e1a04e918abfdcabef53b20c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:38.095178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:38.149894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0316a322e1a04e918abfdcabef53b20c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:38.164148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0316a322e1a04e918abfdcabef53b20c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:38.172912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0316a322e1a04e918abfdcabef53b20c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:38.182187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0316a322e1a04e918abfdcabef53b20c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:38.182187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0316a322e1a04e918abfdcabef53b20c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:38.186734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1066/2114] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:38 2022] DELETE /identity/v3/users/0316a322e1a04e918abfdcabef53b20c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:38.193214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:38.193214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:38.193543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:38.215693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:38.216966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:38.313945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1049/2115] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:38.346570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:38.348429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:38.421165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d61d-57d1-4e9e-b8be-c79eaed42d75 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:38.426386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b12fbf-c096-45de-af77-4181e1770d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:38.427443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12fbf-c096-45de-af77-4181e1770d69 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:38.427443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12fbf-c096-45de-af77-4181e1770d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:38.427672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12fbf-c096-45de-af77-4181e1770d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:38.439941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b12fbf-c096-45de-af77-4181e1770d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:38.441496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b12fbf-c096-45de-af77-4181e1770d69 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:38.452414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1067/2116] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:38.882018 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:38.883811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:38.903301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e407396-c0e6-4063-aff5-c8d5f30cfa8e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:38.909242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:38.910781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:38.911034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:38.911426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] PATH_INFO: `/v3/projects/d2b7faadcca14851ae81b92c3421c3c1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:38.917811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b7faadcca14851ae81b92c3421c3c1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:38.920768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:38.982955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b7faadcca14851ae81b92c3421c3c1', 'request_id': 'req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:38.991344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b7faadcca14851ae81b92c3421c3c1', 'request_id': 'req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:39.000150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b7faadcca14851ae81b92c3421c3c1', 'request_id': 'req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:39.009284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:39.013794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] The token cache is being invalidate because project d2b7faadcca14851ae81b92c3421c3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:39.014648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:39.015973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:39.017962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1050/2117] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:38 2022] DELETE /identity/v3/projects/d2b7faadcca14851ae81b92c3421c3c1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:39.227267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35fac-c86f-4f18-8686-3b900bca01ae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:39.227845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35fac-c86f-4f18-8686-3b900bca01ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:39.227845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35fac-c86f-4f18-8686-3b900bca01ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:39.271956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-69b35fac-c86f-4f18-8686-3b900bca01ae None None] MFA Rules not processed for user `f8b8f37c287341848d8d3b4d5f62873d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:39.273249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69b35fac-c86f-4f18-8686-3b900bca01ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:39.309099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:39.379911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1068/2118] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:39.388103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:39.389658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:39.462780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dced5be-a9a0-48ad-8bac-bf13713a4cc5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:39.466713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51801a-648b-489f-8c7a-776614526196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:39.467371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51801a-648b-489f-8c7a-776614526196 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:39.467650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51801a-648b-489f-8c7a-776614526196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:39.467977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51801a-648b-489f-8c7a-776614526196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:39.477841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51801a-648b-489f-8c7a-776614526196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:39.479296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51801a-648b-489f-8c7a-776614526196 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:39.491628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1051/2119] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:41.014742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:41.015754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:41.015833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:41.049462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] MFA Rules not processed for user `f8b8f37c287341848d8d3b4d5f62873d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:41.055675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:41.076364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1069/2120] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:43.675974 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953815b0-1357-4493-838a-1937ccb3a765 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:43.676666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953815b0-1357-4493-838a-1937ccb3a765 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:43.676666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953815b0-1357-4493-838a-1937ccb3a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:43.707777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-953815b0-1357-4493-838a-1937ccb3a765 None None] MFA Rules not processed for user `2691e1dc96e942b5ba4c726b72a835e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:43.709138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-953815b0-1357-4493-838a-1937ccb3a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:43.779686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1052/2121] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:43.799132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:43.800637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:43.887877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d47435-f545-4e4a-aa5f-1a5baaed5592 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:43.895739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:43.896455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:43.896754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:43.897063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:43.905826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:43.907569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:43.917257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1070/2122] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:45.890725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c232e81-f1dd-4bc5-8271-64bcf4ee2399 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:45.897610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c232e81-f1dd-4bc5-8271-64bcf4ee2399 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:45.898112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c232e81-f1dd-4bc5-8271-64bcf4ee2399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:45.948413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3c232e81-f1dd-4bc5-8271-64bcf4ee2399 None None] MFA Rules not processed for user `2691e1dc96e942b5ba4c726b72a835e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:45.954823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c232e81-f1dd-4bc5-8271-64bcf4ee2399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:45.971116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1053/2123] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:50.717118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:50.719506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:50.797567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a70ad7-0b15-47e4-a1ea-6c18b9f03794 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:50.802804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:50.803671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:50.803953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:50.804264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] PATH_INFO: `/v3/users/88f92e3971b04323a164c65a4f6d7024` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:50.805460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f92e3971b04323a164c65a4f6d7024)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:50.807375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:50.857124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:50.860586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f92e3971b04323a164c65a4f6d7024'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:50.873669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f92e3971b04323a164c65a4f6d7024'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:50.881913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f92e3971b04323a164c65a4f6d7024'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:50.889176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f92e3971b04323a164c65a4f6d7024'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:50.891088 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f92e3971b04323a164c65a4f6d7024'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:50.897202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1071/2124] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:50 2022] DELETE /identity/v3/users/88f92e3971b04323a164c65a4f6d7024 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:50.901798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:50.902260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:50.902383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:50.921422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:50.922644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:50.986519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1054/2125] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:50.996264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:50.997691 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:51.061055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f58ea-ef01-439c-96e8-2f8f9019d6f7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:51.065337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000e035-de0e-4399-8103-97c276e017ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:51.066036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000e035-de0e-4399-8103-97c276e017ad service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:51.066324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000e035-de0e-4399-8103-97c276e017ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:51.066603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000e035-de0e-4399-8103-97c276e017ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:51.079076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000e035-de0e-4399-8103-97c276e017ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:51.081886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000e035-de0e-4399-8103-97c276e017ad service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:51.094643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1072/2126] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:51.402936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:51.404422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:51.422290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8751c6-7397-423c-992b-3683401ea4a0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:51.449081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:51.450208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:51.450584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:51.450950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] PATH_INFO: `/v3/projects/0bc4bb5bd47a4a15beb36ef444bba649` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:51.454798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc4bb5bd47a4a15beb36ef444bba649)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:51.457379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:51.494203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:51.579288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc4bb5bd47a4a15beb36ef444bba649', 'request_id': 'req-b16dcc2c-3647-4146-8345-e30f51348c31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:51.594370 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc4bb5bd47a4a15beb36ef444bba649', 'request_id': 'req-b16dcc2c-3647-4146-8345-e30f51348c31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:51.618445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc4bb5bd47a4a15beb36ef444bba649', 'request_id': 'req-b16dcc2c-3647-4146-8345-e30f51348c31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:51.637224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] The token cache is being invalidate because project 0bc4bb5bd47a4a15beb36ef444bba649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:51.637842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:51.638567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b16dcc2c-3647-4146-8345-e30f51348c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:51.641114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1055/2127] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:51 2022] DELETE /identity/v3/projects/0bc4bb5bd47a4a15beb36ef444bba649 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:51.645882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41dbb6-ea30-41db-8bb2-37f82190b8e0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:51.646181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41dbb6-ea30-41db-8bb2-37f82190b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:51.646465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41dbb6-ea30-41db-8bb2-37f82190b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:51.674299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bf41dbb6-ea30-41db-8bb2-37f82190b8e0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:51.675670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bf41dbb6-ea30-41db-8bb2-37f82190b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:51.781912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1073/2128] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:51.789101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c99a0-1786-47b3-b800-d4effbfe217f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:51.789525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c99a0-1786-47b3-b800-d4effbfe217f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:51.789822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c99a0-1786-47b3-b800-d4effbfe217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:51.813044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-387c99a0-1786-47b3-b800-d4effbfe217f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:51.814347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-387c99a0-1786-47b3-b800-d4effbfe217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:51.825116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1056/2129] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:51.830273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41dbb6-ea30-41db-8bb2-37f82190b8e0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:51.842514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41dbb6-ea30-41db-8bb2-37f82190b8e0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:51.849025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:51.849725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:51.850017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:51.850306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:51.851067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:51.851383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:51.853052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:51.869235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1074/2130] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:02:51.873457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c99a0-1786-47b3-b800-d4effbfe217f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:51.884166 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c99a0-1786-47b3-b800-d4effbfe217f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:51.892031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:51.892744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:51.893037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:51.893313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:51.894538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:51.896161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:51.937500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1057/2131] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:51 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:51.942303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:51.954053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f44f8-9f41-41ce-8b61-424ad64f0317 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.002842 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:52.014197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.015401 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.015734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.016622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.017440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.019584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.044805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1075/2132] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:51 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:52.046160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.056947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aea65-c4bc-4f87-96cd-269395c70611 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.062508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.063261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.063543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.063819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.064589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.066221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.076874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1058/2133] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:52.082045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.093039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57bf31-c315-4f21-bc87-60c95d4cb12c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.098236 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.098941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.099199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.099479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.100250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.101858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.113254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1076/2134] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:02:52.117416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.120942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.122756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.129145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb482-fccb-44a3-b84a-17c651da7d51 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.134247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557003-adab-4d2e-8102-a1d29ded8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.135152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557003-adab-4d2e-8102-a1d29ded8135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.135432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557003-adab-4d2e-8102-a1d29ded8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.135783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557003-adab-4d2e-8102-a1d29ded8135 admin admin] PATH_INFO: `/v3/projects/80177aad3bc54db58877faca05661c5a/users/83ccfcfe3111446b9ba17bc28a137541/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.138700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b6aed-77e7-41b7-9de4-b4c3385d662c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.146138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.147939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.148267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.148557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] PATH_INFO: `/v3/users/e28ac85078a141d88d4065d321b68f6e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.150217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28ac85078a141d88d4065d321b68f6e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.152231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.153306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557003-adab-4d2e-8102-a1d29ded8135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80177aad3bc54db58877faca05661c5a, user_id=83ccfcfe3111446b9ba17bc28a137541, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.156034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557003-adab-4d2e-8102-a1d29ded8135 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.172100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1059/2135] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:52 2022] PUT /identity/v3/projects/80177aad3bc54db58877faca05661c5a/users/83ccfcfe3111446b9ba17bc28a137541/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:52.183143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.183457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.184069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.215038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28ac85078a141d88d4065d321b68f6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.217918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] MFA Rules not processed for user `83ccfcfe3111446b9ba17bc28a137541`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:52.219396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.228609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28ac85078a141d88d4065d321b68f6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.240667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28ac85078a141d88d4065d321b68f6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.253287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28ac85078a141d88d4065d321b68f6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.255099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19ed4ada-ac97-41d8-a375-0129258841ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28ac85078a141d88d4065d321b68f6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.265837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1077/2136] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:52 2022] DELETE /identity/v3/users/e28ac85078a141d88d4065d321b68f6e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:52.267334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.267634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.268045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.287317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:52.288340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.297455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1060/2137] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:52.311068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.313778 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.356400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:52.363874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1078/2138] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:52.374541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.376102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.381165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d35b3-59cf-4fe6-bf0b-be0187710e25 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.427539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:52.433950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88421fe-174e-4880-8b8a-daeeacbe5932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.434614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88421fe-174e-4880-8b8a-daeeacbe5932 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.435006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88421fe-174e-4880-8b8a-daeeacbe5932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.435181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88421fe-174e-4880-8b8a-daeeacbe5932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.441424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a039e5-4db6-4cf3-89d6-d1009b12f08a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.445954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.446611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.446899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.447378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.458199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.459664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.470340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1079/2139] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:02:52.500423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88421fe-174e-4880-8b8a-daeeacbe5932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.501922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88421fe-174e-4880-8b8a-daeeacbe5932 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.512385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1061/2140] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:52.541063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.542673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.558174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07a361-e5c8-46ee-9d38-1b6481fdc6e5 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.570752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.571769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.572109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.572432 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] PATH_INFO: `/v3/users/83ccfcfe3111446b9ba17bc28a137541` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.574311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ccfcfe3111446b9ba17bc28a137541)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.576677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.645605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ccfcfe3111446b9ba17bc28a137541'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.661347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ccfcfe3111446b9ba17bc28a137541'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.669282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ccfcfe3111446b9ba17bc28a137541'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.679381 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ccfcfe3111446b9ba17bc28a137541'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.680370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ccfcfe3111446b9ba17bc28a137541'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.687846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1080/2141] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:02:52 2022] DELETE /identity/v3/users/83ccfcfe3111446b9ba17bc28a137541 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:52.692386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2020-5579-4925-a9ef-bf207de116db None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.692702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2020-5579-4925-a9ef-bf207de116db None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.692984 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2020-5579-4925-a9ef-bf207de116db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.724048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-daee2020-5579-4925-a9ef-bf207de116db None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:52.725271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-daee2020-5579-4925-a9ef-bf207de116db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.800705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.802635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.819155 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1062/2142] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:52.831686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee2020-5579-4925-a9ef-bf207de116db None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:52.833740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-daee2020-5579-4925-a9ef-bf207de116db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:52.911338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325dd7f-b7a1-44dd-a297-4182319a35e1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.916473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.916827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:52.917612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.917973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.918409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] PATH_INFO: `/v3/projects/77ed35795b1846b386a51d189c6b74d8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.919882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ed35795b1846b386a51d189c6b74d8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.922551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.930390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee2020-5579-4925-a9ef-bf207de116db None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:52.938775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a74f9-a06e-4cbd-b177-d3b3b862c8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:52.939479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a74f9-a06e-4cbd-b177-d3b3b862c8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:52.939730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a74f9-a06e-4cbd-b177-d3b3b862c8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:52.940044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a74f9-a06e-4cbd-b177-d3b3b862c8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:52.956899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a74f9-a06e-4cbd-b177-d3b3b862c8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:52.958590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a74f9-a06e-4cbd-b177-d3b3b862c8b1 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:52.974251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1063/2143] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:52.985766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ed35795b1846b386a51d189c6b74d8', 'request_id': 'req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.992671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ed35795b1846b386a51d189c6b74d8', 'request_id': 'req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:52.997225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:53.002838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ed35795b1846b386a51d189c6b74d8', 'request_id': 'req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.020047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] The token cache is being invalidate because project 77ed35795b1846b386a51d189c6b74d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:53.020360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.021042 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3dd56051-23c0-41f4-aab9-b8318e5e4a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.033120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1081/2144] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:52 2022] DELETE /identity/v3/projects/77ed35795b1846b386a51d189c6b74d8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:02:53.038584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08b6c-1c1d-4f4e-848a-ec739a03a7d9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.038880 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08b6c-1c1d-4f4e-848a-ec739a03a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.039264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08b6c-1c1d-4f4e-848a-ec739a03a7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.067510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8ab08b6c-1c1d-4f4e-848a-ec739a03a7d9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:53.069061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8ab08b6c-1c1d-4f4e-848a-ec739a03a7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.178820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1064/2145] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:53.179754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63823-9c40-417b-b079-d411fef083eb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.180163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63823-9c40-417b-b079-d411fef083eb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.180520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63823-9c40-417b-b079-d411fef083eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.205583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-50f63823-9c40-417b-b079-d411fef083eb None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:53.206926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50f63823-9c40-417b-b079-d411fef083eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.217047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1082/2146] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:53.221810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08b6c-1c1d-4f4e-848a-ec739a03a7d9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.242567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08b6c-1c1d-4f4e-848a-ec739a03a7d9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.248861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.249632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.250007 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.250380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.251225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:53.251660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.253449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.266699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1065/2147] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:02:53.271251 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63823-9c40-417b-b079-d411fef083eb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.281618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63823-9c40-417b-b079-d411fef083eb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.286480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.287156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.287443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.287719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.288536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.291322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.326103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1083/2148] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:53.333922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.345025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3abfa-f6a5-474d-8b3f-ccd5e8ed76bb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.355971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.357880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.425932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.426620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.426910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.427190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.427899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.430009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.451801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7fe31-6c0c-48c2-a771-0b6053b336b2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.457026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.457994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.460050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1066/2149] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:02:53.460216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.460216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] PATH_INFO: `/v3/projects/80177aad3bc54db58877faca05661c5a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.460819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80177aad3bc54db58877faca05661c5a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.462419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.463162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.475303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f6e77-05d6-4821-a0be-38079f2c6fc0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.480223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.480976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.481183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.481693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.482452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.485182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.496943 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1067/2150] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:53.502083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.514324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c362-ce32-4da6-9346-adcc3e924506 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.532359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80177aad3bc54db58877faca05661c5a', 'request_id': 'req-cd195494-c7f3-4835-8a63-2a28808fb12c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.540594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80177aad3bc54db58877faca05661c5a', 'request_id': 'req-cd195494-c7f3-4835-8a63-2a28808fb12c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.552490 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80177aad3bc54db58877faca05661c5a', 'request_id': 'req-cd195494-c7f3-4835-8a63-2a28808fb12c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.566204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] The token cache is being invalidate because project 80177aad3bc54db58877faca05661c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:02:53.566563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.567176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cd195494-c7f3-4835-8a63-2a28808fb12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:02:53.568922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1084/2151] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:02:53 2022] DELETE /identity/v3/projects/80177aad3bc54db58877faca05661c5a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:53.573673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992798-e43e-4a79-8d87-4aab8dcdf7d8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.574030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992798-e43e-4a79-8d87-4aab8dcdf7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.574379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992798-e43e-4a79-8d87-4aab8dcdf7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.585385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:53.594956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.595502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-76992798-e43e-4a79-8d87-4aab8dcdf7d8 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:53.596271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.596756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-76992798-e43e-4a79-8d87-4aab8dcdf7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.596940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.597276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.598422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.600978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.606312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1085/2152] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:53.615825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248388e3-672c-4836-9a8b-ecdc2a815bd2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.616353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248388e3-672c-4836-9a8b-ecdc2a815bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.616834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248388e3-672c-4836-9a8b-ecdc2a815bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.621808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1068/2153] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:53.625738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.627468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.640750 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aefa00-0b32-4764-ba52-e1a51b302ca3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.643636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-248388e3-672c-4836-9a8b-ecdc2a815bd2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:53.644908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-248388e3-672c-4836-9a8b-ecdc2a815bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.645862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.646798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.647089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.647371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] PATH_INFO: `/v3/projects/475a9fb135a148cfa07496c594e990ee/users/af72547411dc4208949e319e7d543a44/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.653378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1086/2154] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:53.658382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248388e3-672c-4836-9a8b-ecdc2a815bd2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.664708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475a9fb135a148cfa07496c594e990ee, user_id=af72547411dc4208949e319e7d543a44, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.667480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.667676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248388e3-672c-4836-9a8b-ecdc2a815bd2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.674837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0ff1a-0385-4fd2-b9ba-9eb3132b8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.675852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0ff1a-0385-4fd2-b9ba-9eb3132b8352 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.676246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0ff1a-0385-4fd2-b9ba-9eb3132b8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.676674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0ff1a-0385-4fd2-b9ba-9eb3132b8352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.677592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0ff1a-0385-4fd2-b9ba-9eb3132b8352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:02:53.678118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0ff1a-0385-4fd2-b9ba-9eb3132b8352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.680048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0ff1a-0385-4fd2-b9ba-9eb3132b8352 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.691186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1069/2155] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:53 2022] PUT /identity/v3/projects/475a9fb135a148cfa07496c594e990ee/users/af72547411dc4208949e319e7d543a44/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:53.692506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1087/2156] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:02:53.698485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.701234 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.701529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.702922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.732685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] MFA Rules not processed for user `af72547411dc4208949e319e7d543a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:53.734600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.748515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:53.784547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f738-8eb6-4ec7-a903-792c04fde139 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.789805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.790483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.790760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.791039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.791751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.794034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.832615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1070/2157] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:53.836607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.845138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1088/2158] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:02:53.857114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.859474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:53.909825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793cdc-9229-46b3-8b2f-ce2696523d68 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.916343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.917041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.917336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.917619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.918329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.920312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.923678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afcd19-adbe-40ca-8741-0b0b98733a6f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.945105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1071/2159] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:02:53 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:02:53.949267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.961332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71609-5948-46ba-a721-2177dee63639 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:53.966732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.967431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.968347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.969541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:53.969541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:53.971079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:53.988116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1072/2160] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:53.992429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:53.993106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:53.993789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:53.994073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:53.994356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:54.004307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc1e5e-0b4f-4284-99fe-9e8d08e2f3ab admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:54.009629 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:54.010327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:54.010785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:54.011299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:54.012105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:54.014833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:54.033436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1073/2161] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:02:54.034766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:54.048617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489708a-764a-494e-be7f-3874e879c501 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:54.054730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5a99f-351b-4afe-87db-0e3672d62689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:54.055658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a99f-351b-4afe-87db-0e3672d62689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:54.055945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a99f-351b-4afe-87db-0e3672d62689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:54.056897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a99f-351b-4afe-87db-0e3672d62689 admin admin] PATH_INFO: `/v3/projects/fbbc7667eb34449fb8ae5adb5916025d/users/7214f9024ca94bc892857a7296a727df/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:54.078185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5a99f-351b-4afe-87db-0e3672d62689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbc7667eb34449fb8ae5adb5916025d, user_id=7214f9024ca94bc892857a7296a727df, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:54.081096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5a99f-351b-4afe-87db-0e3672d62689 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:54.087540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:54.099848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:54.103673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:54.112100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1074/2162] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:02:54 2022] PUT /identity/v3/projects/fbbc7667eb34449fb8ae5adb5916025d/users/7214f9024ca94bc892857a7296a727df/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:02:54.116127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1089/2163] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:02:54.117399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb332eb-9634-48f4-93dd-0439ffe662b0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:54.118310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb332eb-9634-48f4-93dd-0439ffe662b0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:54.119092 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb332eb-9634-48f4-93dd-0439ffe662b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:54.168423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cfb332eb-9634-48f4-93dd-0439ffe662b0 None None] MFA Rules not processed for user `7214f9024ca94bc892857a7296a727df`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:54.170074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cfb332eb-9634-48f4-93dd-0439ffe662b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:54.303818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1075/2164] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:02:54.310565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:02:54.312626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:54.351318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:54.393539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdf30f-1090-4df6-8d7e-158ca9b49a1b service glance] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:02:54.451511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccc85a-38be-4ba7-b23a-33550e24c35a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:02:54.453420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccc85a-38be-4ba7-b23a-33550e24c35a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:54.453714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccc85a-38be-4ba7-b23a-33550e24c35a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:54.453994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccc85a-38be-4ba7-b23a-33550e24c35a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:54.466745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccc85a-38be-4ba7-b23a-33550e24c35a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:02:54.469262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccc85a-38be-4ba7-b23a-33550e24c35a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:02:54.480368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1090/2165] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:02:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:02:55.975456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:02:55.976219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:02:55.976219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:02:56.007459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] MFA Rules not processed for user `7214f9024ca94bc892857a7296a727df`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:02:56.008779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:02:56.033912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1076/2166] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:02:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:04.475779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=36 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:06.031896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=49 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:40.465357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da51af9-9b87-4f87-8356-9abd42b9fd0d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:40.465888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da51af9-9b87-4f87-8356-9abd42b9fd0d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:40.465888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da51af9-9b87-4f87-8356-9abd42b9fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:40.497625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7da51af9-9b87-4f87-8356-9abd42b9fd0d None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:40.499560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7da51af9-9b87-4f87-8356-9abd42b9fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:40.577568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1091/2167] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:40.618759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:40.620223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:40.695581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac806-b866-4cf8-8e75-29402090cf7e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:40.700688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:40.701838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:40.702206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:40.702408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:40.711261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:40.712945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:40.724533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1077/2168] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:03:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:03:41.265250 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd929-c6d3-430f-b772-9912f4183839 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:41.265542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd929-c6d3-430f-b772-9912f4183839 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:41.265826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd929-c6d3-430f-b772-9912f4183839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:41.286951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-026fd929-c6d3-430f-b772-9912f4183839 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:41.288189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-026fd929-c6d3-430f-b772-9912f4183839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:41.296188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1092/2169] 10.222.0.69 () {58 vars in 967 bytes} [Thu May 26 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:41.308593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:41.319907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2b961-e539-43c7-a7fe-2e195741e05f service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:41.324924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:41.325559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:41.325841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:41.326125 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:41.334754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:41.336363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:41.344776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1078/2170] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:03:41.563360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79835ef-3fd7-4954-9af0-af4b68e1115a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:41.563850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79835ef-3fd7-4954-9af0-af4b68e1115a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:41.563935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79835ef-3fd7-4954-9af0-af4b68e1115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:41.582082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e79835ef-3fd7-4954-9af0-af4b68e1115a None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:41.583294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e79835ef-3fd7-4954-9af0-af4b68e1115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:41.590430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1093/2171] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:41.603595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:41.615867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbf7e-4c5e-4db1-905b-6c1d82066325 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:41.621096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:41.621749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:41.622038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:41.622322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:41.631052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:41.632687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:41.641288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1079/2172] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:03:41.985992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc959-ef71-4a6f-aa2e-9486ee08e927 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:41.986290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc959-ef71-4a6f-aa2e-9486ee08e927 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:41.986577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc959-ef71-4a6f-aa2e-9486ee08e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:42.006045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2dbcc959-ef71-4a6f-aa2e-9486ee08e927 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:42.007247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2dbcc959-ef71-4a6f-aa2e-9486ee08e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:42.014791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1094/2173] 10.222.0.69 () {58 vars in 967 bytes} [Thu May 26 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:42.026867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:42.038770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2ee5-9a8d-4de5-9eac-6c2f87a9db9a service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:42.045286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8990a-5aa4-4f66-a759-89e8ef769295 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:42.045956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8990a-5aa4-4f66-a759-89e8ef769295 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:42.046248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8990a-5aa4-4f66-a759-89e8ef769295 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:42.046534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8990a-5aa4-4f66-a759-89e8ef769295 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:42.055604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8990a-5aa4-4f66-a759-89e8ef769295 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:42.057260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8990a-5aa4-4f66-a759-89e8ef769295 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:42.067160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1080/2174] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:03:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:03:44.207745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc959-ef71-4a6f-aa2e-9486ee08e927 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:44.307272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc959-ef71-4a6f-aa2e-9486ee08e927 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:44.314091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:44.315437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:44.316209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:44.316550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] PATH_INFO: `/v3/users/7214f9024ca94bc892857a7296a727df` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:44.318024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7214f9024ca94bc892857a7296a727df)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:44.320282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:44.404667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:44.406304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7214f9024ca94bc892857a7296a727df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:44.433618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7214f9024ca94bc892857a7296a727df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:44.446819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7214f9024ca94bc892857a7296a727df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:44.460071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7214f9024ca94bc892857a7296a727df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:44.460864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7214f9024ca94bc892857a7296a727df'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:44.476462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1095/2175] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:03:44 2022] DELETE /identity/v3/users/7214f9024ca94bc892857a7296a727df => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:44.481890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:44.482476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:44.482650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:44.548888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:44.550244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:44.633908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1081/2176] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:44.646794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:44.648636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:44.811688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103fc9f-689d-4910-a300-fe582f66e545 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:44.816423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a7a5-8cc4-4133-8705-a7693772fa47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:44.817090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a7a5-8cc4-4133-8705-a7693772fa47 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:44.817375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a7a5-8cc4-4133-8705-a7693772fa47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:44.817657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a7a5-8cc4-4133-8705-a7693772fa47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:44.828973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a7a5-8cc4-4133-8705-a7693772fa47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:44.830510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a7a5-8cc4-4133-8705-a7693772fa47 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:44.841965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1096/2177] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:03:45.129890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.131352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:45.145189 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589d299-d116-4db4-9046-006c6bf113f0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.150521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.151565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.152520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.152810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] PATH_INFO: `/v3/projects/fbbc7667eb34449fb8ae5adb5916025d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.154535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbc7667eb34449fb8ae5adb5916025d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.157114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.187523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:45.216476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbc7667eb34449fb8ae5adb5916025d', 'request_id': 'req-8c44d198-ce78-4247-82a7-36d918732ae9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:45.223988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbc7667eb34449fb8ae5adb5916025d', 'request_id': 'req-8c44d198-ce78-4247-82a7-36d918732ae9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:45.229833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbc7667eb34449fb8ae5adb5916025d', 'request_id': 'req-8c44d198-ce78-4247-82a7-36d918732ae9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:45.241752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] The token cache is being invalidate because project fbbc7667eb34449fb8ae5adb5916025d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:03:45.242042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:45.242719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8c44d198-ce78-4247-82a7-36d918732ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:45.244317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1082/2178] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:03:45 2022] DELETE /identity/v3/projects/fbbc7667eb34449fb8ae5adb5916025d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:45.250300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6fc3-4e7b-4da1-a0af-f0561b78ebf7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.250802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6fc3-4e7b-4da1-a0af-f0561b78ebf7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.250909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6fc3-4e7b-4da1-a0af-f0561b78ebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.298511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-aa6a6fc3-4e7b-4da1-a0af-f0561b78ebf7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:45.299739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aa6a6fc3-4e7b-4da1-a0af-f0561b78ebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:45.362148 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1097/2179] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:45.370282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb385e-1738-4287-99a2-5e00a87aef99 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.370574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb385e-1738-4287-99a2-5e00a87aef99 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.370858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb385e-1738-4287-99a2-5e00a87aef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.391492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-65bb385e-1738-4287-99a2-5e00a87aef99 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:45.392786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65bb385e-1738-4287-99a2-5e00a87aef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:45.401334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1083/2180] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:03:45.406431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a6fc3-4e7b-4da1-a0af-f0561b78ebf7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.416773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a6fc3-4e7b-4da1-a0af-f0561b78ebf7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.422459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.423150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.423435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.423715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.424504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:03:45.424818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.426470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.440411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1098/2181] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:03:45.444815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb385e-1738-4287-99a2-5e00a87aef99 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.454791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb385e-1738-4287-99a2-5e00a87aef99 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.459720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.460405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.460689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.460966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.461665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.463567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.492142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1084/2182] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:03:45 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:03:45.496277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.502246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:45.512944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f312b-aa97-4820-8ee9-733fcf59464b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.589979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.590669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.590975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.591240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.592526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.594466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.618929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1099/2183] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:03:45 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:03:45.623304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.635097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aeba8-759a-4ebb-b005-0b4a97cc759c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.641779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.645106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.645416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.645703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.646609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.649410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.665571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1085/2184] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:45.666782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.680041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540edb3-912f-4b74-85d5-d13701ce6830 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.686441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cbd50-18eb-45bb-9608-50888a8d9062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.686705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbd50-18eb-45bb-9608-50888a8d9062 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.687047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbd50-18eb-45bb-9608-50888a8d9062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.687340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbd50-18eb-45bb-9608-50888a8d9062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.688125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cbd50-18eb-45bb-9608-50888a8d9062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.689917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cbd50-18eb-45bb-9608-50888a8d9062 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.710268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1100/2185] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:45.714740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.726669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d6a2-cf90-48e9-9489-b527bd1e3eb1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.732305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.733266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.733662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.733909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] PATH_INFO: `/v3/projects/fce9015638524279b09969d5aacda2ba/users/0c8a0ec84d3c471f9e6baa548f0d045a/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.753448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce9015638524279b09969d5aacda2ba, user_id=0c8a0ec84d3c471f9e6baa548f0d045a, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.758627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.776651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1086/2186] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:03:45 2022] PUT /identity/v3/projects/fce9015638524279b09969d5aacda2ba/users/0c8a0ec84d3c471f9e6baa548f0d045a/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:45.782607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.782909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.783192 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.802807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:45.804109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:45.894289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1101/2187] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:45.908314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.913535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:45.995489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9dd3-e371-4d5b-927c-058921736cec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:46.000695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dd422-38c1-4978-88d2-52de7be843f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:46.001293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd422-38c1-4978-88d2-52de7be843f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:46.001605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd422-38c1-4978-88d2-52de7be843f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:46.001892 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dd422-38c1-4978-88d2-52de7be843f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:46.015236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dd422-38c1-4978-88d2-52de7be843f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:46.016914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dd422-38c1-4978-88d2-52de7be843f5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:46.027578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1087/2188] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:49.135559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:49.137985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:49.151523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff15ca-a0d2-4124-acda-da4f55348fb0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:49.164976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:49.165878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:49.166355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:49.166635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] PATH_INFO: `/v3/users/af72547411dc4208949e319e7d543a44` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:49.171642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af72547411dc4208949e319e7d543a44)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:49.173834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:49.275434 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af72547411dc4208949e319e7d543a44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:49.304794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af72547411dc4208949e319e7d543a44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:49.327224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af72547411dc4208949e319e7d543a44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:49.333496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:49.340748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af72547411dc4208949e319e7d543a44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:49.341970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af72547411dc4208949e319e7d543a44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:49.357948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1102/2189] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:03:49 2022] DELETE /identity/v3/users/af72547411dc4208949e319e7d543a44 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:49.362427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51854ad-f50f-4929-bb6e-3c9cc653370d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:49.362961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51854ad-f50f-4929-bb6e-3c9cc653370d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:49.363061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51854ad-f50f-4929-bb6e-3c9cc653370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:49.408364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e51854ad-f50f-4929-bb6e-3c9cc653370d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:49.409609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e51854ad-f50f-4929-bb6e-3c9cc653370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:49.537561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:49.573419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1088/2190] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:49.695176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:49.696783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:49.862952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8ce04-7e8f-4add-bb72-22eaaa99cf61 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:49.867127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:49.867801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:49.868235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:49.868421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:49.881134 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:49.883371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:49.904585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1103/2191] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:49.966730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:49.967031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:49.967634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:50.132174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:50.135331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:50.365726 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1089/2192] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:03:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:50.399271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:50.401884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:50.561133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22f1fb-6eca-4271-9f9b-36cc12a4d67b service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:50.566844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bca3e3-0e80-4bfe-b52a-3b1eaae02055 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:50.567530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca3e3-0e80-4bfe-b52a-3b1eaae02055 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:50.567818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca3e3-0e80-4bfe-b52a-3b1eaae02055 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:50.568398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bca3e3-0e80-4bfe-b52a-3b1eaae02055 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:50.580375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bca3e3-0e80-4bfe-b52a-3b1eaae02055 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:50.581537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bca3e3-0e80-4bfe-b52a-3b1eaae02055 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:50.592266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1104/2193] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:03:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:03:50.641363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:50.642982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:50.675346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61f5d9-066f-4de6-8ac5-97abddfbf265 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:50.680704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:50.684381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:50.688297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:50.688772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] PATH_INFO: `/v3/projects/475a9fb135a148cfa07496c594e990ee` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:50.693697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=475a9fb135a148cfa07496c594e990ee)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:50.695975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:50.876728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475a9fb135a148cfa07496c594e990ee', 'request_id': 'req-510e78eb-f268-45d0-92bd-32574172d0ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:50.907446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475a9fb135a148cfa07496c594e990ee', 'request_id': 'req-510e78eb-f268-45d0-92bd-32574172d0ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:50.924452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475a9fb135a148cfa07496c594e990ee', 'request_id': 'req-510e78eb-f268-45d0-92bd-32574172d0ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:50.949069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] The token cache is being invalidate because project 475a9fb135a148cfa07496c594e990ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:03:50.949747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:50.950951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-510e78eb-f268-45d0-92bd-32574172d0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:50.953485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1090/2194] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:03:50 2022] DELETE /identity/v3/projects/475a9fb135a148cfa07496c594e990ee => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:50.958551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106670-3508-40ef-a7a0-5865ae48d3ef None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:50.958883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106670-3508-40ef-a7a0-5865ae48d3ef None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:50.959121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106670-3508-40ef-a7a0-5865ae48d3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:50.997220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-10106670-3508-40ef-a7a0-5865ae48d3ef None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:50.999338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-10106670-3508-40ef-a7a0-5865ae48d3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:51.168892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1105/2195] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:51.179981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac85-bc7a-4e9f-831a-2f7c7d68ee06 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:51.180619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac85-bc7a-4e9f-831a-2f7c7d68ee06 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:51.181157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac85-bc7a-4e9f-831a-2f7c7d68ee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:51.264549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e665ac85-bc7a-4e9f-831a-2f7c7d68ee06 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:51.269886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e665ac85-bc7a-4e9f-831a-2f7c7d68ee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:51.301830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106670-3508-40ef-a7a0-5865ae48d3ef None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:51.302372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1091/2196] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:51.350124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106670-3508-40ef-a7a0-5865ae48d3ef None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:51.396733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:51.397867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:51.404070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:51.407093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:51.410039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:03:51.410642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:51.423759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:51.438185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:51.494326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1106/2197] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:03:51.504141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ac85-bc7a-4e9f-831a-2f7c7d68ee06 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:51.535180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ac85-bc7a-4e9f-831a-2f7c7d68ee06 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:51.564097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:51.566775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:51.570037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:51.571069 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:51.572847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:51.579027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:51.680446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1092/2198] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:03:51 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:03:51.682252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:51.708710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085364f-a697-46cd-ab72-c3ea366b4f73 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:51.878926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:51.880068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:51.880361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:51.880638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:51.881356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:51.884190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:51.914137 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1107/2199] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:03:51 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:03:51.920097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:51.969435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fdc5-8913-4ce7-ae6c-44f96a9b7d62 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:52.000218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:52.001466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:52.006382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:52.006977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:52.008151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:52.017200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:52.064433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:52.068197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1093/2200] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:52.078839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945f439-ba94-4e73-baa3-982807357e4c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:52.100870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812732a-f2c0-488c-88cc-1a7db415b6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:52.101398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812732a-f2c0-488c-88cc-1a7db415b6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:52.101687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812732a-f2c0-488c-88cc-1a7db415b6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:52.101965 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812732a-f2c0-488c-88cc-1a7db415b6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:52.102726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812732a-f2c0-488c-88cc-1a7db415b6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:52.105045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812732a-f2c0-488c-88cc-1a7db415b6e8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:52.118661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1108/2201] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:52.128379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:52.136950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:52.151384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317cfe5-88f7-4979-bb0f-cf5f8fcbe12a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:52.159041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:52.160466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:52.161284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:52.161772 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] PATH_INFO: `/v3/projects/920d86da8196449ebfaf571f60b2d1e7/users/80a82b79776b4c79ae125e33a43d987e/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:52.214797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920d86da8196449ebfaf571f60b2d1e7, user_id=80a82b79776b4c79ae125e33a43d987e, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:52.218522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:52.240094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1094/2202] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:03:52 2022] PUT /identity/v3/projects/920d86da8196449ebfaf571f60b2d1e7/users/80a82b79776b4c79ae125e33a43d987e/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:52.250702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7068343-541c-429d-8f75-d9f43e2cf802 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:52.250996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7068343-541c-429d-8f75-d9f43e2cf802 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:52.251396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7068343-541c-429d-8f75-d9f43e2cf802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:52.302903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c7068343-541c-429d-8f75-d9f43e2cf802 None None] MFA Rules not processed for user `80a82b79776b4c79ae125e33a43d987e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:52.302903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c7068343-541c-429d-8f75-d9f43e2cf802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:52.465009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1109/2203] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:52.483773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:52.485684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:52.760881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810fcc-5655-4939-93cc-25b7a2433f46 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:52.765916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:52.767360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:52.767659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:52.768004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:52.790662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:52.792524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:52.814815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1095/2204] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:03:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:54.804419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d80e5c-ecd9-4cfb-b268-f4a5dc4d3024 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:54.805470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d80e5c-ecd9-4cfb-b268-f4a5dc4d3024 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:54.805943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d80e5c-ecd9-4cfb-b268-f4a5dc4d3024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:54.850056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d0d80e5c-ecd9-4cfb-b268-f4a5dc4d3024 None None] MFA Rules not processed for user `0c8a0ec84d3c471f9e6baa548f0d045a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:54.853424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d0d80e5c-ecd9-4cfb-b268-f4a5dc4d3024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:55.024580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:55.066012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1110/2205] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:55.070283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:55.071831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:55.251307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f275568-a02d-48db-a7b4-a992d5dfe370 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:55.260944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:55.261640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:55.261927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:55.262199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:55.263234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:55.270740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:55.371641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1096/2206] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:03:55 2022] POST /identity/v3/projects => generated 371 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:03:55.375459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d80e5c-ecd9-4cfb-b268-f4a5dc4d3024 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:55.394750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d80e5c-ecd9-4cfb-b268-f4a5dc4d3024 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:55.598377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:55.599474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:55.599986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:55.600505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:55.601428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:55.607861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:55.666475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1111/2207] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:03:55 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:03:55.669018 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:55.702076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791f5b7-e535-4e43-82d4-3ce1a39c55ca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:55.716841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:55.717916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:55.718344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:55.718638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:55.719889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:55.723695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:55.781092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:55.782240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1097/2208] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:55.800129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff1c4f-bb78-4e97-8372-a932cfcc2fde admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:55.820906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:55.822652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:55.823123 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:55.823566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] PATH_INFO: `/v3/projects/be9c648c22834924abf2abc300b7e3ef/users/cdd181daf69b4198929bea64402905e2/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:55.858841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9c648c22834924abf2abc300b7e3ef, user_id=cdd181daf69b4198929bea64402905e2, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:55.862022 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:55.894987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1112/2209] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:03:55 2022] PUT /identity/v3/projects/be9c648c22834924abf2abc300b7e3ef/users/cdd181daf69b4198929bea64402905e2/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:55.896609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:55.913136 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3da5f-79e6-4caa-8f61-8404f7d22180 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:55.977513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:56.006062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:56.007053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:56.007513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:56.008286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:56.008597 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:56.010251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:56.023828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1098/2210] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:56.030884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:56.045673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56e0f-e00e-43c2-8a95-644ebbc0fa60 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:56.052646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26482eb-31ba-4e92-b5ab-b2646aa6276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:56.053673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26482eb-31ba-4e92-b5ab-b2646aa6276b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:56.054009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26482eb-31ba-4e92-b5ab-b2646aa6276b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:56.054383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26482eb-31ba-4e92-b5ab-b2646aa6276b admin admin] PATH_INFO: `/v3/projects/be9c648c22834924abf2abc300b7e3ef/users/cdd181daf69b4198929bea64402905e2/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:56.059216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26482eb-31ba-4e92-b5ab-b2646aa6276b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9c648c22834924abf2abc300b7e3ef, user_id=cdd181daf69b4198929bea64402905e2, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:56.065161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26482eb-31ba-4e92-b5ab-b2646aa6276b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:56.084057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1113/2211] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:03:56 2022] PUT /identity/v3/projects/be9c648c22834924abf2abc300b7e3ef/users/cdd181daf69b4198929bea64402905e2/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:56.740593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:56.767392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7f1b-58b5-4037-a350-bf7b37361bfa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:56.890977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:56.892347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:56.892763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:56.894563 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] PATH_INFO: `/v3/users/80a82b79776b4c79ae125e33a43d987e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:56.896094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a82b79776b4c79ae125e33a43d987e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:56.898514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:57.039445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a82b79776b4c79ae125e33a43d987e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:57.056394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a82b79776b4c79ae125e33a43d987e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:57.069332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a82b79776b4c79ae125e33a43d987e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:57.070467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a82b79776b4c79ae125e33a43d987e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:57.110135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a82b79776b4c79ae125e33a43d987e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:57.128964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1099/2212] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:03:56 2022] DELETE /identity/v3/users/80a82b79776b4c79ae125e33a43d987e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:57.133447 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:57.133954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:57.133954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:57.190102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:57.191790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:57.429668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1114/2213] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:57.449771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:57.453297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:57.605086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd144d-b278-4e7e-8b56-081ae8594e01 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:57.628180 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffabf6a-d420-4b7d-b86c-305769b7f311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:57.628953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffabf6a-d420-4b7d-b86c-305769b7f311 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:57.629316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffabf6a-d420-4b7d-b86c-305769b7f311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:57.629676 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffabf6a-d420-4b7d-b86c-305769b7f311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:57.658049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:57.666664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffabf6a-d420-4b7d-b86c-305769b7f311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:57.668269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffabf6a-d420-4b7d-b86c-305769b7f311 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:57.709554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1100/2214] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:58.610856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:58.612857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:58.642055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e888f-b296-4916-86ff-090d9d7a7a1f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:58.652605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:58.654880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:58.655330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:58.655755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] PATH_INFO: `/v3/projects/920d86da8196449ebfaf571f60b2d1e7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:58.657295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920d86da8196449ebfaf571f60b2d1e7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:58.660069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:58.733876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:58.745496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920d86da8196449ebfaf571f60b2d1e7', 'request_id': 'req-3fe47642-e23c-4c5c-8c3b-57c3097526b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:58.776263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920d86da8196449ebfaf571f60b2d1e7', 'request_id': 'req-3fe47642-e23c-4c5c-8c3b-57c3097526b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:58.790121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920d86da8196449ebfaf571f60b2d1e7', 'request_id': 'req-3fe47642-e23c-4c5c-8c3b-57c3097526b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:58.809892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] The token cache is being invalidate because project 920d86da8196449ebfaf571f60b2d1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:03:58.810456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:58.811361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3fe47642-e23c-4c5c-8c3b-57c3097526b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:03:58.813581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1115/2215] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:03:58 2022] DELETE /identity/v3/projects/920d86da8196449ebfaf571f60b2d1e7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:58.819451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550a6c-b3cc-4e5f-9276-f9fada700785 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:58.820097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550a6c-b3cc-4e5f-9276-f9fada700785 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:58.820097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550a6c-b3cc-4e5f-9276-f9fada700785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:58.853191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-90550a6c-b3cc-4e5f-9276-f9fada700785 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:58.855546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-90550a6c-b3cc-4e5f-9276-f9fada700785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:58.940610 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1101/2216] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:58.948102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcd81-9a80-4225-8e1b-aa3503a819c2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:58.948744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcd81-9a80-4225-8e1b-aa3503a819c2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:58.949227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcd81-9a80-4225-8e1b-aa3503a819c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.022693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-666fcd81-9a80-4225-8e1b-aa3503a819c2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:59.023975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-666fcd81-9a80-4225-8e1b-aa3503a819c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:59.050777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1116/2217] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:59.052417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90550a6c-b3cc-4e5f-9276-f9fada700785 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:59.096921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90550a6c-b3cc-4e5f-9276-f9fada700785 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:59.120269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:59.121274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.121410 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.121709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.123329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:03:59.123794 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:59.134602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:59.178604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1102/2218] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:03:59.180126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fcd81-9a80-4225-8e1b-aa3503a819c2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:59.198515 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fcd81-9a80-4225-8e1b-aa3503a819c2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:59.209374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:59.210231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.210846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.211244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.214815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:59.217276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:59.270885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1117/2219] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:03:59 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:03:59.275096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:59.286989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89de62-585e-4758-b955-b9a7504f43c6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:59.406962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:59.407975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.408512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.408985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.410163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:59.412769 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:59.448839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1103/2220] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:03:59 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:03:59.451732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:59.467140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ef76-e83b-4239-82f3-b0b8ce046394 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:59.488226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:59.489069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.493772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.494179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.496441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:59.503263 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:59.542183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1118/2221] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:59.545556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:59.572231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a815205-3bb4-45f0-8409-72026bb90b14 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:59.598365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62948347-5720-4e10-9a20-53bfe9d5d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:59.602326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948347-5720-4e10-9a20-53bfe9d5d095 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.603960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948347-5720-4e10-9a20-53bfe9d5d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.603960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62948347-5720-4e10-9a20-53bfe9d5d095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.604671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62948347-5720-4e10-9a20-53bfe9d5d095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:59.616503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62948347-5720-4e10-9a20-53bfe9d5d095 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:59.650003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1104/2222] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:03:59.650801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:59.675454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374f2e-0b11-4a08-92b9-5e4928277d9b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:59.701344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:59.702743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.703035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.703316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] PATH_INFO: `/v3/projects/8b52ea0b97054cb980d1d79047a95acd/users/ae404c25f74d448aa42a72cd819ef532/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.740816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b52ea0b97054cb980d1d79047a95acd, user_id=ae404c25f74d448aa42a72cd819ef532, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:59.745171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:59.791360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1119/2223] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:03:59 2022] PUT /identity/v3/projects/8b52ea0b97054cb980d1d79047a95acd/users/ae404c25f74d448aa42a72cd819ef532/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:03:59.803728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899f87-ef30-438f-b98a-e33ef238e443 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.804081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899f87-ef30-438f-b98a-e33ef238e443 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.804330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899f87-ef30-438f-b98a-e33ef238e443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.901886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-61899f87-ef30-438f-b98a-e33ef238e443 None None] MFA Rules not processed for user `ae404c25f74d448aa42a72cd819ef532`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:59.921375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-61899f87-ef30-438f-b98a-e33ef238e443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:00.043576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:00.111096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1105/2224] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:03:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:00.118646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:00.123075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:00.320504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6517f-07a0-4531-9397-ac8e170a7e0d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:00.327501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c44a-b8b9-49ce-a946-e18d90dff993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:00.330665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c44a-b8b9-49ce-a946-e18d90dff993 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:00.331221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c44a-b8b9-49ce-a946-e18d90dff993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:00.332683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c44a-b8b9-49ce-a946-e18d90dff993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:00.352474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c44a-b8b9-49ce-a946-e18d90dff993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:00.354570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c44a-b8b9-49ce-a946-e18d90dff993 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:00.367489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1120/2225] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:04:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:04:01.548104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bffa3-39a5-4666-9260-20a56f7d73f2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:01.548632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bffa3-39a5-4666-9260-20a56f7d73f2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:01.548783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bffa3-39a5-4666-9260-20a56f7d73f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:01.582883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-055bffa3-39a5-4666-9260-20a56f7d73f2 None None] MFA Rules not processed for user `5b5c8dedd274447da8ee4600feb6a26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:01.588161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-055bffa3-39a5-4666-9260-20a56f7d73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:01.739254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1106/2226] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:04:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:05.446144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:05.449720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:05.449720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:05.508246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] MFA Rules not processed for user `f8b8f37c287341848d8d3b4d5f62873d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:05.511092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:05.676985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1121/2227] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:04:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:06.669835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f639a-a339-4d08-bd4d-fd42f489c352 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:06.670408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f639a-a339-4d08-bd4d-fd42f489c352 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:06.670408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f639a-a339-4d08-bd4d-fd42f489c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:06.761792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-363f639a-a339-4d08-bd4d-fd42f489c352 None None] MFA Rules not processed for user `cdd181daf69b4198929bea64402905e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:06.763620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-363f639a-a339-4d08-bd4d-fd42f489c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:06.945946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1107/2228] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:04:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:06.953322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:06.955087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:06.975399 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:07.150871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ea794-8776-4fa3-b753-cac046ac535c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:07.164711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:07.165549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:07.165933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:07.166446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:07.172575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:07.325834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:07.329902 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:07.356352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1122/2229] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:04:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:11.167421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c0dd-bb35-40e3-b7b5-38bdfd5633d7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:11.168578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c0dd-bb35-40e3-b7b5-38bdfd5633d7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:11.169009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59c0dd-bb35-40e3-b7b5-38bdfd5633d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:11.212821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3a59c0dd-bb35-40e3-b7b5-38bdfd5633d7 None None] MFA Rules not processed for user `0c8a0ec84d3c471f9e6baa548f0d045a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:11.214100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a59c0dd-bb35-40e3-b7b5-38bdfd5633d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:11.261702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1108/2230] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:13.546644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:13.550271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:13.785304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6deed-3f4f-4952-bbb3-6ca8bcf00842 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:13.792113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04411d8-3076-4d59-b9dc-3a908a9e97c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:13.794081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04411d8-3076-4d59-b9dc-3a908a9e97c8 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:13.794379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04411d8-3076-4d59-b9dc-3a908a9e97c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:13.794666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04411d8-3076-4d59-b9dc-3a908a9e97c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:13.796665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f04411d8-3076-4d59-b9dc-3a908a9e97c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:13.831491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04411d8-3076-4d59-b9dc-3a908a9e97c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:13.847870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04411d8-3076-4d59-b9dc-3a908a9e97c8 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:13.861913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:13.875704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1123/2231] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:04:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:17.304587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59c0dd-bb35-40e3-b7b5-38bdfd5633d7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:17.372623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59c0dd-bb35-40e3-b7b5-38bdfd5633d7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:17.377599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:17.378472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.378756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.379034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] PATH_INFO: `/v3/users/ae404c25f74d448aa42a72cd819ef532` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.380242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae404c25f74d448aa42a72cd819ef532)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:17.382178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:17.398351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:17.429388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae404c25f74d448aa42a72cd819ef532'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:17.439879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae404c25f74d448aa42a72cd819ef532'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:17.440559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae404c25f74d448aa42a72cd819ef532'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:17.441143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae404c25f74d448aa42a72cd819ef532'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:17.456789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae404c25f74d448aa42a72cd819ef532'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:17.476123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1109/2232] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:04:17 2022] DELETE /identity/v3/users/ae404c25f74d448aa42a72cd819ef532 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:04:17.478732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.479206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.479389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.508895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:17.510555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:17.597045 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1124/2233] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:04:17.609102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:17.610195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:17.689830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5db0-6749-4a38-bd37-ce10217be0d0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:17.697313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fd78a-c33b-44f8-87d9-2c9eb953788b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:17.698078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fd78a-c33b-44f8-87d9-2c9eb953788b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.698426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fd78a-c33b-44f8-87d9-2c9eb953788b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.698760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fd78a-c33b-44f8-87d9-2c9eb953788b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.709216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fd78a-c33b-44f8-87d9-2c9eb953788b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:17.710671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fd78a-c33b-44f8-87d9-2c9eb953788b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:17.721852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1110/2234] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:18.145623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:18.147072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:18.172962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a195ecd-a56b-4dbf-b2c0-8263f721ec59 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:18.194180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:18.198427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:18.201692 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:18.202683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] PATH_INFO: `/v3/projects/8b52ea0b97054cb980d1d79047a95acd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:18.205683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b52ea0b97054cb980d1d79047a95acd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:18.209462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:18.352448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b52ea0b97054cb980d1d79047a95acd', 'request_id': 'req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:18.370138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b52ea0b97054cb980d1d79047a95acd', 'request_id': 'req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:18.396054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b52ea0b97054cb980d1d79047a95acd', 'request_id': 'req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:18.457114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] The token cache is being invalidate because project 8b52ea0b97054cb980d1d79047a95acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:04:18.458496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:18.460397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb144f99-08c9-4aa8-98a9-dbdd10f6b20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:04:18.467736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1125/2235] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:04:18 2022] DELETE /identity/v3/projects/8b52ea0b97054cb980d1d79047a95acd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:04:20.946341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c468d-71bf-4a4c-ad2d-ae6ab7887079 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:20.946895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c468d-71bf-4a4c-ad2d-ae6ab7887079 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:20.947120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c468d-71bf-4a4c-ad2d-ae6ab7887079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:20.973526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-143c468d-71bf-4a4c-ad2d-ae6ab7887079 None None] MFA Rules not processed for user `2691e1dc96e942b5ba4c726b72a835e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:20.974988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-143c468d-71bf-4a4c-ad2d-ae6ab7887079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:21.052663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1111/2236] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:04:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:25.149726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079bf7-df52-4706-8230-54db15ab9ccf None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.150747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079bf7-df52-4706-8230-54db15ab9ccf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.152744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079bf7-df52-4706-8230-54db15ab9ccf None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.154577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1126/2237] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:04:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:04:25.177569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c3b7-bbd8-4fd1-89a4-e790e4d4a9ac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.178117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c3b7-bbd8-4fd1-89a4-e790e4d4a9ac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.178384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c3b7-bbd8-4fd1-89a4-e790e4d4a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.287825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6186c3b7-bbd8-4fd1-89a4-e790e4d4a9ac None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:25.290881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6186c3b7-bbd8-4fd1-89a4-e790e4d4a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:25.339832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:25.413263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1112/2238] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:25.438533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8079bf7-df52-4706-8230-54db15ab9ccf None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:25.440425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f8079bf7-df52-4706-8230-54db15ab9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:25.540870 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8079bf7-df52-4706-8230-54db15ab9ccf None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:25.550986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157e24d-9b08-450d-8fe4-2e7029ef0f96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:25.551747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157e24d-9b08-450d-8fe4-2e7029ef0f96 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.552143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157e24d-9b08-450d-8fe4-2e7029ef0f96 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.552972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157e24d-9b08-450d-8fe4-2e7029ef0f96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.565688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157e24d-9b08-450d-8fe4-2e7029ef0f96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:25.567430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157e24d-9b08-450d-8fe4-2e7029ef0f96 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:25.597298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1127/2239] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:04:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:25.705468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec499-b51e-4890-8117-8faeee0cc3da None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.705981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec499-b51e-4890-8117-8faeee0cc3da None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.706465 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec499-b51e-4890-8117-8faeee0cc3da None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.709047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1113/2240] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:04:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:04:25.715745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444460-01e5-474f-810f-bf2a33ab3089 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.715745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444460-01e5-474f-810f-bf2a33ab3089 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.715745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444460-01e5-474f-810f-bf2a33ab3089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.724121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:25.738852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ae444460-01e5-474f-810f-bf2a33ab3089 None None] MFA Rules not processed for user `eadb39271321475ebb10382db43db0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:25.742128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ae444460-01e5-474f-810f-bf2a33ab3089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:25.827950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1128/2241] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:04:25.877571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ec499-b51e-4890-8117-8faeee0cc3da None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:25.879839 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce6ec499-b51e-4890-8117-8faeee0cc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:25.895625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ec499-b51e-4890-8117-8faeee0cc3da None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:25.900223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32d6c2-118f-4567-835e-3bcc73304913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:25.901025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d6c2-118f-4567-835e-3bcc73304913 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.901302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d6c2-118f-4567-835e-3bcc73304913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.902251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d6c2-118f-4567-835e-3bcc73304913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.920649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32d6c2-118f-4567-835e-3bcc73304913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:25.924717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32d6c2-118f-4567-835e-3bcc73304913 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:25.951938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1114/2242] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:04:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:26.052981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17059-971d-41a4-a74f-34f1474bf48f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:26.053437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17059-971d-41a4-a74f-34f1474bf48f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:26.055185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17059-971d-41a4-a74f-34f1474bf48f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:26.055856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1129/2243] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:04:26.063279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132628-faf3-4fb3-b1de-056a65d2ca36 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:26.063612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132628-faf3-4fb3-b1de-056a65d2ca36 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:26.063844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132628-faf3-4fb3-b1de-056a65d2ca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:26.091286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2f132628-faf3-4fb3-b1de-056a65d2ca36 None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:26.092804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2f132628-faf3-4fb3-b1de-056a65d2ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:26.107874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1115/2244] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:04:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:26.118582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17059-971d-41a4-a74f-34f1474bf48f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:26.132596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17059-971d-41a4-a74f-34f1474bf48f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:26.139217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:26.141094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:26.141094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:26.141764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:26.163647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:26.166567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:26.192494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1130/2245] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:04:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:04:31.734630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9d306-3568-4a9e-9791-c9c707e064ed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:31.735209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9d306-3568-4a9e-9791-c9c707e064ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:31.735209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9d306-3568-4a9e-9791-c9c707e064ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:31.753664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-13f9d306-3568-4a9e-9791-c9c707e064ed None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:31.754888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-13f9d306-3568-4a9e-9791-c9c707e064ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:31.825090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1116/2246] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:04:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:31.840090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:31.840090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:31.928046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ae05-ab0e-414f-85aa-4d8db7f5e61d service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:31.938281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:31.939325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:31.939996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:31.940519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:31.955334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:31.957013 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:31.966738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1131/2247] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:04:41.817283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=52 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:41.963004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=59 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:03.364574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1c7ab-7c94-44bb-aa49-9bcb3fc27ebe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:03.365508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1c7ab-7c94-44bb-aa49-9bcb3fc27ebe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:03.365508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1c7ab-7c94-44bb-aa49-9bcb3fc27ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:03.388675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-25b1c7ab-7c94-44bb-aa49-9bcb3fc27ebe None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:03.390040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-25b1c7ab-7c94-44bb-aa49-9bcb3fc27ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:03.398038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1117/2248] 10.222.0.69 () {58 vars in 967 bytes} [Thu May 26 18:05:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:05:03.427780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:03.445627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2cfb-0aaf-4808-94eb-c9611c8f7fd8 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:03.455291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:03.456572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:03.457091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:03.457594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:03.474469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:03.477843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:03.495220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1132/2249] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:05:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:05:08.286175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1c7ab-7c94-44bb-aa49-9bcb3fc27ebe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:08.297828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1c7ab-7c94-44bb-aa49-9bcb3fc27ebe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:08.301720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:08.302389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:08.302670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:08.302947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:08.304967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:08.385215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:08.386734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:08.399332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1118/2250] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:05:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:13.487476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:18.393385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=33 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:31.601090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:31.603611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:31.719463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f1d17-7ad7-4a73-a666-ce9dd45adbbd service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:31.726734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:31.728044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:31.728540 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:31.729158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] PATH_INFO: `/v3/users/f8b8f37c287341848d8d3b4d5f62873d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:31.731828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b8f37c287341848d8d3b4d5f62873d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:31.734234 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:31.837180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b8f37c287341848d8d3b4d5f62873d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:31.855269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b8f37c287341848d8d3b4d5f62873d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:31.868659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b8f37c287341848d8d3b4d5f62873d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:31.878378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b8f37c287341848d8d3b4d5f62873d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:31.879274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83acf1f7-8792-4414-99ce-3aff1a9f7707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b8f37c287341848d8d3b4d5f62873d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:31.888189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1133/2251] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:05:31 2022] DELETE /identity/v3/users/f8b8f37c287341848d8d3b4d5f62873d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:05:32.119773 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.144416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce699ae-3034-4198-b604-b535ea011be3 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.262483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.263725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.263847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.264148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] PATH_INFO: `/v3/projects/9fdf6152e6874f78825e5eddb7f14158` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.265994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdf6152e6874f78825e5eddb7f14158)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.268403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.329905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdf6152e6874f78825e5eddb7f14158', 'request_id': 'req-1054cc70-f7f7-42a0-97cd-2f0c985db533'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:32.339642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdf6152e6874f78825e5eddb7f14158', 'request_id': 'req-1054cc70-f7f7-42a0-97cd-2f0c985db533'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:32.350070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdf6152e6874f78825e5eddb7f14158', 'request_id': 'req-1054cc70-f7f7-42a0-97cd-2f0c985db533'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:32.374349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] The token cache is being invalidate because project 9fdf6152e6874f78825e5eddb7f14158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:05:32.374781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:32.375904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1054cc70-f7f7-42a0-97cd-2f0c985db533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:05:32.378678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1119/2252] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:05:32 2022] DELETE /identity/v3/projects/9fdf6152e6874f78825e5eddb7f14158 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:05:32.385976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e075-136f-481c-8585-3bd5443b5772 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.386401 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e075-136f-481c-8585-3bd5443b5772 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.386909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e075-136f-481c-8585-3bd5443b5772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.407541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9410e075-136f-481c-8585-3bd5443b5772 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:32.408969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9410e075-136f-481c-8585-3bd5443b5772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:32.481741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1134/2253] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:32.493603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8310c-bef8-4fda-8556-8aba8fc5d861 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.493988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8310c-bef8-4fda-8556-8aba8fc5d861 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.494476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8310c-bef8-4fda-8556-8aba8fc5d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.527531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-38f8310c-bef8-4fda-8556-8aba8fc5d861 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:32.529436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38f8310c-bef8-4fda-8556-8aba8fc5d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:32.544789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1120/2254] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:32.549278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410e075-136f-481c-8585-3bd5443b5772 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.566424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410e075-136f-481c-8585-3bd5443b5772 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.572138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.572829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.573125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.573409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.574162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:05:32.574479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.576219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.591921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1135/2255] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:05:32.601505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8310c-bef8-4fda-8556-8aba8fc5d861 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.611835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8310c-bef8-4fda-8556-8aba8fc5d861 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.617951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.618690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.619018 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.619340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.620240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.622313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.653858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1121/2256] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:05:32 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:05:32.658673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.671288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301a4b3-5425-4d72-8080-f82aac9a5f0c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.675231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:32.745522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.746216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.746500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.746781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.747495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.753219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.781521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1136/2257] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:05:32 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:05:32.785821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.804428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33972ce-c7ab-4471-8a17-17fb0ccbe9cf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.811255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.811991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.812326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.812615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.813373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.815043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.827538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1122/2258] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:05:32.834193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.853507 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177b72-657e-4d41-a043-d299ddfc16c4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.861435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db962be-2d7e-40c3-bc6a-2fe684040f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.862554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db962be-2d7e-40c3-bc6a-2fe684040f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.863040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db962be-2d7e-40c3-bc6a-2fe684040f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.863512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db962be-2d7e-40c3-bc6a-2fe684040f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.864861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db962be-2d7e-40c3-bc6a-2fe684040f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.868164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db962be-2d7e-40c3-bc6a-2fe684040f89 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.890895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1137/2259] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:05:32.892603 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.909662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d14416-f8c5-4c28-96eb-f1e2fe20eff3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.916269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.917427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.917805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.918179 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] PATH_INFO: `/v3/projects/ba5a75cf80284f58b9c3bed674677a39/users/9683ec43ae844757883a7dd5003b53d9/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.946099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5a75cf80284f58b9c3bed674677a39, user_id=9683ec43ae844757883a7dd5003b53d9, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.951853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.975493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1123/2260] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:05:32 2022] PUT /identity/v3/projects/ba5a75cf80284f58b9c3bed674677a39/users/9683ec43ae844757883a7dd5003b53d9/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:05:32.981548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58585-b86e-4c00-ae31-56b514ca9dd0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.981995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58585-b86e-4c00-ae31-56b514ca9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.982387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58585-b86e-4c00-ae31-56b514ca9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:33.006372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-50e58585-b86e-4c00-ae31-56b514ca9dd0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:33.008364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50e58585-b86e-4c00-ae31-56b514ca9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:33.091083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1138/2261] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:33.102154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:33.104268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:33.140780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:33.176916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51ded-62dd-43bc-9127-d22d83bdf6c6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:33.181290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:33.181968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:33.182250 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:33.182534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:33.193073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:33.195064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:33.206316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1124/2262] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:38.545715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d242d-57d3-404f-a046-799b9a2d826a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:38.546563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d242d-57d3-404f-a046-799b9a2d826a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:38.546563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d242d-57d3-404f-a046-799b9a2d826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:38.591276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dd8d242d-57d3-404f-a046-799b9a2d826a None None] MFA Rules not processed for user `9683ec43ae844757883a7dd5003b53d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:38.593550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dd8d242d-57d3-404f-a046-799b9a2d826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:38.686429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1139/2263] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:05:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:38.691119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:38.702219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338800c-ba01-4092-acd6-a50daebaf717 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:38.707389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:38.708104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:38.708392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:38.708673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:38.709389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:38.712080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:38.744800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1125/2264] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:05:38 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:05:38.749820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d242d-57d3-404f-a046-799b9a2d826a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:38.767042 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d242d-57d3-404f-a046-799b9a2d826a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:38.783808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:38.845380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:38.846085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:38.846374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:38.846660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:38.847396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:38.849788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:38.874547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1140/2265] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:05:38 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:05:38.880003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:38.907073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d11c3-cd60-48aa-bf59-5d3813c64d9d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:38.920494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:38.921605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:38.922099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:38.922583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:38.923954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:38.926671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:38.951332 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1126/2266] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:05:38.956595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:38.971773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c7f0e-01cd-445d-8dff-60877317a7eb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:38.979958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:38.981135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:38.981568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:38.981975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] PATH_INFO: `/v3/projects/7020bb1806764dd299f457750912d975/users/a1dbbfc48cc642688950b14f5cddf28f/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:39.010047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7020bb1806764dd299f457750912d975, user_id=a1dbbfc48cc642688950b14f5cddf28f, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:39.012824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:39.034141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1141/2267] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:05:38 2022] PUT /identity/v3/projects/7020bb1806764dd299f457750912d975/users/a1dbbfc48cc642688950b14f5cddf28f/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:05:39.039481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:39.052306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5c6f2-0c13-4ea9-83ec-245f15cda865 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:39.150484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5c9a1-08a2-4101-8aee-3ddc7a2bbaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:39.151584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c9a1-08a2-4101-8aee-3ddc7a2bbaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:39.152200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c9a1-08a2-4101-8aee-3ddc7a2bbaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:39.152615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c9a1-08a2-4101-8aee-3ddc7a2bbaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:39.154044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5c9a1-08a2-4101-8aee-3ddc7a2bbaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:39.157258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5c9a1-08a2-4101-8aee-3ddc7a2bbaa8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:39.177089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1127/2268] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:05:39.183440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:39.199304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e8f6c-2fa5-47e6-a95d-b04745e4d0fa admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:39.204552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:39.205466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:39.205761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:39.206046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] PATH_INFO: `/v3/projects/7020bb1806764dd299f457750912d975/users/a1dbbfc48cc642688950b14f5cddf28f/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:39.208589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7020bb1806764dd299f457750912d975, user_id=a1dbbfc48cc642688950b14f5cddf28f, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:39.211370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:39.226678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1142/2269] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:05:39 2022] PUT /identity/v3/projects/7020bb1806764dd299f457750912d975/users/a1dbbfc48cc642688950b14f5cddf28f/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:05:45.677858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a373a8-2f39-41b7-b24d-8448969e8de2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:45.678457 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a373a8-2f39-41b7-b24d-8448969e8de2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:45.678650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a373a8-2f39-41b7-b24d-8448969e8de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:45.719474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c0a373a8-2f39-41b7-b24d-8448969e8de2 None None] MFA Rules not processed for user `a1dbbfc48cc642688950b14f5cddf28f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:45.720896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c0a373a8-2f39-41b7-b24d-8448969e8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:45.833878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1128/2270] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:45.849762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:45.852416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:45.953464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64225-e08b-41a5-8960-3d64cc8f256b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:45.959205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a75a66-49c4-4394-b619-3c0b58888689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:45.959914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a75a66-49c4-4394-b619-3c0b58888689 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:45.960253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a75a66-49c4-4394-b619-3c0b58888689 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:45.960576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a75a66-49c4-4394-b619-3c0b58888689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:46.026989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a75a66-49c4-4394-b619-3c0b58888689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:46.028684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a75a66-49c4-4394-b619-3c0b58888689 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:46.040908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1143/2271] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:05:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:55.829657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:56.034545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:03.191348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03f2f3-b2aa-438b-818f-2611c540cf15 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:03.191924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03f2f3-b2aa-438b-818f-2611c540cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:03.192324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03f2f3-b2aa-438b-818f-2611c540cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:03.215027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9b03f2f3-b2aa-438b-818f-2611c540cf15 None None] MFA Rules not processed for user `5b5c8dedd274447da8ee4600feb6a26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:03.216657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b03f2f3-b2aa-438b-818f-2611c540cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:03.313805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1129/2272] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:03.975899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e81d0-ebae-4b3b-afac-2a8f14ec88c7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:03.976429 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e81d0-ebae-4b3b-afac-2a8f14ec88c7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:03.977105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e81d0-ebae-4b3b-afac-2a8f14ec88c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:04.014048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dd6e81d0-ebae-4b3b-afac-2a8f14ec88c7 None None] MFA Rules not processed for user `9683ec43ae844757883a7dd5003b53d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:04.016622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dd6e81d0-ebae-4b3b-afac-2a8f14ec88c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:04.040303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1144/2273] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:05.849760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1eb80-d9b8-4e20-a67e-c833fff033c4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:05.850383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1eb80-d9b8-4e20-a67e-c833fff033c4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:05.851068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1eb80-d9b8-4e20-a67e-c833fff033c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:05.874153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-59b1eb80-d9b8-4e20-a67e-c833fff033c4 None None] MFA Rules not processed for user `a7cc6fcd7b4c4cee8d21e2692757aaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:05.875265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-59b1eb80-d9b8-4e20-a67e-c833fff033c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:05.958174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1130/2274] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:07.173382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:07.173861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:07.173861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:07.202333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] MFA Rules not processed for user `2691e1dc96e942b5ba4c726b72a835e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:07.204767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:07.301208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1145/2275] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:06:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:13.689532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1eb80-d9b8-4e20-a67e-c833fff033c4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:13.752752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1eb80-d9b8-4e20-a67e-c833fff033c4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:13.760214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:13.760879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:13.761195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:13.761594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:13.763837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:13.782231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:13.783805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:13.797425 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1131/2276] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:15.360767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:15.363047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:15.385298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8191ab-ea6c-438e-8aff-717ed1f84f5c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:15.391880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9592c-9f5e-4828-9f2f-bc25dbb05fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:15.393210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9592c-9f5e-4828-9f2f-bc25dbb05fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:15.393725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9592c-9f5e-4828-9f2f-bc25dbb05fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:15.394232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9592c-9f5e-4828-9f2f-bc25dbb05fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:15.398678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e1f9592c-9f5e-4828-9f2f-bc25dbb05fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:15.425313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9592c-9f5e-4828-9f2f-bc25dbb05fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:15.428314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9592c-9f5e-4828-9f2f-bc25dbb05fb7 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:15.451511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1146/2277] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:06:23.656942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:23.696928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff25e-c6a1-4769-89ce-37f5cc5900ab service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:23.711681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:23.714623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:23.715487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:23.715943 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:23.718550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:23.732820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:23.734661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:23.746519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1132/2278] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:25.441834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=34 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:26.624684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b6c7-5fcf-4d9d-8f7f-603993c0abf5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:26.625366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b6c7-5fcf-4d9d-8f7f-603993c0abf5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:26.625923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b6c7-5fcf-4d9d-8f7f-603993c0abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:26.648175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0a23b6c7-5fcf-4d9d-8f7f-603993c0abf5 None None] MFA Rules not processed for user `a95761f42af64635b051051e397d0fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:26.650600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a23b6c7-5fcf-4d9d-8f7f-603993c0abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:26.741038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1147/2279] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:06:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:27.314161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:27.319818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=83 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:27.326224 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92806c-96e8-4c46-950f-ba84f64725fd service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:27.330889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:27.331601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:27.331970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:27.332599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:27.334572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:27.347234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:27.349586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:27.362900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1133/2280] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:06:27.631772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b6c7-5fcf-4d9d-8f7f-603993c0abf5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:27.646077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b6c7-5fcf-4d9d-8f7f-603993c0abf5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:27.650444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:27.651180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:27.651536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:27.651827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:27.664405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:27.666114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:27.678513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1148/2281] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:06:27.867314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:27.870748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:27.969954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b342-a4d6-4b26-b678-21ae7aac925f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:27.976407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:27.977089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:27.977376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:27.977655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:27.979661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:27.992709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:27.994584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:28.006727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1134/2282] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:28.930282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:28.952464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7a70b-eb50-4549-af74-6ab6276ae566 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:28.963978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:28.965450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:28.965977 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:28.966474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:28.969847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:28.997494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:29.000884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:29.018441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1149/2283] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:30.690872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:30.713085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3886d-773d-42c7-941e-0a2c857cca69 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:30.720572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:30.721916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:30.722897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:30.723456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:30.727203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:30.745008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:30.747134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:30.760195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1135/2284] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:39.010422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=37 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:40.754304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=43 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:47.416990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:47.418814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:47.486752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8040e6-e917-4271-85ec-c3564144bb0b service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:47.491906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:47.492616 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:47.492924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:47.493201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:47.495182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:47.515397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:47.516959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:47.527786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1150/2285] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:54.221966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.224646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:54.255734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891944-11aa-435d-9753-ed9502b2156d service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.264399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69130495-cf15-4c6e-8e47-90e94480ad1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.265764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69130495-cf15-4c6e-8e47-90e94480ad1a service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.266305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69130495-cf15-4c6e-8e47-90e94480ad1a service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.266804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69130495-cf15-4c6e-8e47-90e94480ad1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.270785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-69130495-cf15-4c6e-8e47-90e94480ad1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:54.293133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69130495-cf15-4c6e-8e47-90e94480ad1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.296218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69130495-cf15-4c6e-8e47-90e94480ad1a service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.311687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1136/2286] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:57.522833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=26 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:04.305487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.284876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.295846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3166-96da-421c-847e-d4dc939de32d service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.300582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085824d-86d3-4850-b130-9fb9d5903f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.301262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085824d-86d3-4850-b130-9fb9d5903f99 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.301556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085824d-86d3-4850-b130-9fb9d5903f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.301835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085824d-86d3-4850-b130-9fb9d5903f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.303746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4085824d-86d3-4850-b130-9fb9d5903f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:08.381501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085824d-86d3-4850-b130-9fb9d5903f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:08.383145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085824d-86d3-4850-b130-9fb9d5903f99 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:08.395090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1151/2287] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:12.781481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80127c8-9f44-4522-9b15-8e9474d345dd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:12.782429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80127c8-9f44-4522-9b15-8e9474d345dd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:12.782429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80127c8-9f44-4522-9b15-8e9474d345dd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:12.785445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1137/2288] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:07:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:12.822327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f8ba-daa2-4db8-87c8-5d1c0084e3b4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:12.823186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f8ba-daa2-4db8-87c8-5d1c0084e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:12.823186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f8ba-daa2-4db8-87c8-5d1c0084e3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:12.870030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80127c8-9f44-4522-9b15-8e9474d345dd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:12.872321 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d80127c8-9f44-4522-9b15-8e9474d345dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:12.881982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e868f8ba-daa2-4db8-87c8-5d1c0084e3b4 None None] MFA Rules not processed for user `2071d6186946488aac5df5fe4ab55c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:12.883372 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e868f8ba-daa2-4db8-87c8-5d1c0084e3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:12.891431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80127c8-9f44-4522-9b15-8e9474d345dd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:12.893694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1152/2289] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:07:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:12.896677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:12.897680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:12.898066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:12.898500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] PATH_INFO: `/v3/users/5b5c8dedd274447da8ee4600feb6a26c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:12.900119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5c8dedd274447da8ee4600feb6a26c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:12.901969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:12.905582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f8ba-daa2-4db8-87c8-5d1c0084e3b4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:12.917719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f8ba-daa2-4db8-87c8-5d1c0084e3b4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:12.923867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:12.924619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:12.924906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:12.925195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:12.935928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:12.937602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:12.950814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1153/2290] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:07:12.977689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5c8dedd274447da8ee4600feb6a26c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:12.989608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5c8dedd274447da8ee4600feb6a26c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:12.991182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5c8dedd274447da8ee4600feb6a26c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:12.992760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5c8dedd274447da8ee4600feb6a26c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:13.016800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee76b1aa-666d-4c4d-abb1-0341e286db39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5c8dedd274447da8ee4600feb6a26c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:13.031379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1138/2291] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:12 2022] DELETE /identity/v3/users/5b5c8dedd274447da8ee4600feb6a26c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:13.381621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.395060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c9ff-2ee1-48a7-9c7c-4e04870bbef0 service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.489495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.490271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.490603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.490960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] PATH_INFO: `/v3/projects/53288d567a8f426bb068908db481e32e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.493049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53288d567a8f426bb068908db481e32e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.495183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.554948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53288d567a8f426bb068908db481e32e', 'request_id': 'req-cb253e21-26cb-4f20-95f4-c35e4b68029e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:13.562662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53288d567a8f426bb068908db481e32e', 'request_id': 'req-cb253e21-26cb-4f20-95f4-c35e4b68029e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:13.573760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53288d567a8f426bb068908db481e32e', 'request_id': 'req-cb253e21-26cb-4f20-95f4-c35e4b68029e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:13.576725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.589755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] The token cache is being invalidate because project 53288d567a8f426bb068908db481e32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:13.590136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:13.590724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cb253e21-26cb-4f20-95f4-c35e4b68029e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:13.592367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1154/2292] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:13 2022] DELETE /identity/v3/projects/53288d567a8f426bb068908db481e32e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:13.598825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56579-77dc-42c1-ac08-1fae4ed58754 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.599289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56579-77dc-42c1-ac08-1fae4ed58754 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.599732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56579-77dc-42c1-ac08-1fae4ed58754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.632066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-76e56579-77dc-42c1-ac08-1fae4ed58754 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:13.633341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76e56579-77dc-42c1-ac08-1fae4ed58754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:13.714905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1139/2293] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:13.724115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b278-c13a-449a-9bd1-e469526c2131 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.724406 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b278-c13a-449a-9bd1-e469526c2131 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.724635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b278-c13a-449a-9bd1-e469526c2131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.744854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cbf2b278-c13a-449a-9bd1-e469526c2131 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:13.745994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cbf2b278-c13a-449a-9bd1-e469526c2131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:13.754978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1155/2294] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:13.759673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e56579-77dc-42c1-ac08-1fae4ed58754 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.770625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e56579-77dc-42c1-ac08-1fae4ed58754 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.775708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.776504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.776926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.777247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.778049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:13.778399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.780134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.793847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1140/2295] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:13.799252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b278-c13a-449a-9bd1-e469526c2131 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.817062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b278-c13a-449a-9bd1-e469526c2131 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.825087 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.826255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.826740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.827229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.827968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.831788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.865693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1156/2296] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:13 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:13.870961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.890454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a36b1-bdfe-4620-853a-b643b9c85d70 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.966248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.966943 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.967230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.967576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.968847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.971205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.978758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.998710 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1141/2297] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:13 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:14.003825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.015084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751f96-6c42-4f5e-8c88-e3bc049ca95a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.020941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.021631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.021917 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.022198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.022947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.024609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.036875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1157/2298] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:14.042521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.053958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe05c9-117b-43ef-9423-a6099e5febd6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.059871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85efa3-7596-47be-bd6a-cf6f0a0619fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.061247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85efa3-7596-47be-bd6a-cf6f0a0619fa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.061453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85efa3-7596-47be-bd6a-cf6f0a0619fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.061959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85efa3-7596-47be-bd6a-cf6f0a0619fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.063211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85efa3-7596-47be-bd6a-cf6f0a0619fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.066655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85efa3-7596-47be-bd6a-cf6f0a0619fa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.081897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1142/2299] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:14.086534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.098210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a57d-f55b-4214-b299-7e3dd37f776c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.104005 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.105056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.105304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.105583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] PATH_INFO: `/v3/projects/34372c6888af440cbd3a3637596e1975/users/9301e3e32deb4c0581f38fb6b83c13ba/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.123382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34372c6888af440cbd3a3637596e1975, user_id=9301e3e32deb4c0581f38fb6b83c13ba, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.126826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.145207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1158/2300] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:14 2022] PUT /identity/v3/projects/34372c6888af440cbd3a3637596e1975/users/9301e3e32deb4c0581f38fb6b83c13ba/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:14.156405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610d33-4b56-4f64-9d6a-9ee8bd466384 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.156751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610d33-4b56-4f64-9d6a-9ee8bd466384 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.157073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610d33-4b56-4f64-9d6a-9ee8bd466384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.188328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d8610d33-4b56-4f64-9d6a-9ee8bd466384 None None] MFA Rules not processed for user `9301e3e32deb4c0581f38fb6b83c13ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:14.189820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8610d33-4b56-4f64-9d6a-9ee8bd466384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:14.268235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1143/2301] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:14.281227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.284702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:14.413412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136d38d-f190-4edf-ab8a-9d7a433b0b68 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.420153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631dc50-8584-4301-a25d-b18787c3a5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.420844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631dc50-8584-4301-a25d-b18787c3a5d8 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.421129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631dc50-8584-4301-a25d-b18787c3a5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.421413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631dc50-8584-4301-a25d-b18787c3a5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.430779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631dc50-8584-4301-a25d-b18787c3a5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.432469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631dc50-8584-4301-a25d-b18787c3a5d8 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.442613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1159/2302] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:17.251775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8610d33-4b56-4f64-9d6a-9ee8bd466384 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:17.375680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8610d33-4b56-4f64-9d6a-9ee8bd466384 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:17.384476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:17.385998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:17.386490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:17.386976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] PATH_INFO: `/v3/users/9301e3e32deb4c0581f38fb6b83c13ba` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:17.389356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9301e3e32deb4c0581f38fb6b83c13ba)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:17.393492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:17.469239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9301e3e32deb4c0581f38fb6b83c13ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:17.479557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9301e3e32deb4c0581f38fb6b83c13ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:17.480247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9301e3e32deb4c0581f38fb6b83c13ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:17.480888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9301e3e32deb4c0581f38fb6b83c13ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:17.503362 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:17.506085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9301e3e32deb4c0581f38fb6b83c13ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:17.532594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1144/2303] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:17 2022] DELETE /identity/v3/users/9301e3e32deb4c0581f38fb6b83c13ba => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:17.539879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:17.540512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:17.540906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:17.563536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:17.565203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:17.638345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1160/2304] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:17.650796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:17.652813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:17.742087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582587c-b743-44c7-a707-2f43c6fb9a21 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:17.746230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0d9b-f63a-422c-a9b5-d3b080aa11bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:17.746910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0d9b-f63a-422c-a9b5-d3b080aa11bd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:17.747198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0d9b-f63a-422c-a9b5-d3b080aa11bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:17.747472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0d9b-f63a-422c-a9b5-d3b080aa11bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:17.763292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0d9b-f63a-422c-a9b5-d3b080aa11bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:17.765167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0d9b-f63a-422c-a9b5-d3b080aa11bd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:17.777171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1145/2305] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:18.195782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.197759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:18.213146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e120b-29b0-4118-9823-70890bcd7150 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.218219 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.219135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.219986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.221285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] PATH_INFO: `/v3/projects/34372c6888af440cbd3a3637596e1975` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.222788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=34372c6888af440cbd3a3637596e1975)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.225243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.238690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.299883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34372c6888af440cbd3a3637596e1975', 'request_id': 'req-0efd8383-e3f7-4992-9978-b67bf76641ad'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:18.312309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34372c6888af440cbd3a3637596e1975', 'request_id': 'req-0efd8383-e3f7-4992-9978-b67bf76641ad'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:18.325180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34372c6888af440cbd3a3637596e1975', 'request_id': 'req-0efd8383-e3f7-4992-9978-b67bf76641ad'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:18.339346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] The token cache is being invalidate because project 34372c6888af440cbd3a3637596e1975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:18.339652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:18.340383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0efd8383-e3f7-4992-9978-b67bf76641ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:18.341991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1161/2306] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:18 2022] DELETE /identity/v3/projects/34372c6888af440cbd3a3637596e1975 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:18.351427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f175c-a420-476f-a05e-b2f216eaca8f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.352309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f175c-a420-476f-a05e-b2f216eaca8f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.352309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f175c-a420-476f-a05e-b2f216eaca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.386983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b84f175c-a420-476f-a05e-b2f216eaca8f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:18.389310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b84f175c-a420-476f-a05e-b2f216eaca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:18.519508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1146/2307] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:18.533802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398d3f-cba5-40ed-bbff-c8c96b7f3f61 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.534194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398d3f-cba5-40ed-bbff-c8c96b7f3f61 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.534721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398d3f-cba5-40ed-bbff-c8c96b7f3f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.566407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-81398d3f-cba5-40ed-bbff-c8c96b7f3f61 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:18.568698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-81398d3f-cba5-40ed-bbff-c8c96b7f3f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:18.587040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1162/2308] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:18.590100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f175c-a420-476f-a05e-b2f216eaca8f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.611270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f175c-a420-476f-a05e-b2f216eaca8f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.620385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.622215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.622694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.628348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.629302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:18.629609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.631327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.647653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1147/2309] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:18.652931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398d3f-cba5-40ed-bbff-c8c96b7f3f61 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.663027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398d3f-cba5-40ed-bbff-c8c96b7f3f61 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.668290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.669077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.669440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.669790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.670590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.673474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.704866 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1163/2310] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:18 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:07:18.709514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.726413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d22df-5fa0-4dce-bf53-e6f650172b9f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.821377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.822542 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.823031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.823513 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.825144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.829109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.861503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1148/2311] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:18 2022] POST /identity/v3/users => generated 278 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:18.866393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.879586 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f0c6-cf94-44ff-b47d-3c39abf3acfe admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.885112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.885814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.886103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.886364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.887145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.888983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.902071 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1164/2312] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:18.906531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.917630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becce18-cc4b-41a9-9477-b6a32349756f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.922574 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b522508-aee4-4a25-9ba1-3ffd372ff018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.924153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b522508-aee4-4a25-9ba1-3ffd372ff018 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.924617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b522508-aee4-4a25-9ba1-3ffd372ff018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.924944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b522508-aee4-4a25-9ba1-3ffd372ff018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.925765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b522508-aee4-4a25-9ba1-3ffd372ff018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.927656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b522508-aee4-4a25-9ba1-3ffd372ff018 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.929802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.944732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1149/2313] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:18.949240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.962342 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8347d-fc6f-4ef7-9f21-2db1e0d541a2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.969530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.970896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.971298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.971698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] PATH_INFO: `/v3/projects/fe12777d7f4144e394b3fadafd232853/users/f8a0042fa00149f29bef5032608ee2d5/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.990265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe12777d7f4144e394b3fadafd232853, user_id=f8a0042fa00149f29bef5032608ee2d5, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.993065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.009366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1165/2314] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:18 2022] PUT /identity/v3/projects/fe12777d7f4144e394b3fadafd232853/users/f8a0042fa00149f29bef5032608ee2d5/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:19.020557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32caf8-ae90-4525-9e56-3d1d6bc6a6c7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.020981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32caf8-ae90-4525-9e56-3d1d6bc6a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.021117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32caf8-ae90-4525-9e56-3d1d6bc6a6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.054426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6e32caf8-ae90-4525-9e56-3d1d6bc6a6c7 None None] MFA Rules not processed for user `f8a0042fa00149f29bef5032608ee2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:19.055634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6e32caf8-ae90-4525-9e56-3d1d6bc6a6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:19.135326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1150/2315] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:19 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:19.139845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.227097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149ea18-98b8-4e54-b586-ac789e972bc3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.235307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.236503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.237001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.237487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.238832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.242805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.290089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1166/2316] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:19 2022] POST /identity/v3/projects => generated 357 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:07:19.294495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32caf8-ae90-4525-9e56-3d1d6bc6a6c7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.314566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32caf8-ae90-4525-9e56-3d1d6bc6a6c7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.417956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.420712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.421082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.421434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.422263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.425215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.464083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1151/2317] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:19 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:19.467241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.489166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1bd0f-cd01-4340-a276-f06bfbc7c982 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.503994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.505635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.506304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.506969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.508804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.512589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.553869 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1167/2318] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:19.558435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.571558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25d8bf-1798-4465-a49a-d1e1a28cc10a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.577571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.578507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.578801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.579144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] PATH_INFO: `/v3/projects/7225dc8ec43a4c0d9e7ce3acb9591bda/users/8c3b7e6fb1124d4898b87c83f63ff6b5/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.605499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7225dc8ec43a4c0d9e7ce3acb9591bda, user_id=8c3b7e6fb1124d4898b87c83f63ff6b5, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.612282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.638988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1152/2319] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:19 2022] PUT /identity/v3/projects/7225dc8ec43a4c0d9e7ce3acb9591bda/users/8c3b7e6fb1124d4898b87c83f63ff6b5/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:19.644737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.660639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea70c9b-9ae5-4bcb-82be-36bd709c5dba admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.670537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.782611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cdf36-f8c0-4be9-a286-d18f4b165af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.782611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cdf36-f8c0-4be9-a286-d18f4b165af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.782611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cdf36-f8c0-4be9-a286-d18f4b165af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.782611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cdf36-f8c0-4be9-a286-d18f4b165af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.790879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cdf36-f8c0-4be9-a286-d18f4b165af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.790879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cdf36-f8c0-4be9-a286-d18f4b165af1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.808102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1168/2320] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:19.812705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.826070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab05d9-8729-4bcd-88c6-557c05cd5ba4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.832314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.833308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.833621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.833897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] PATH_INFO: `/v3/projects/7225dc8ec43a4c0d9e7ce3acb9591bda/users/8c3b7e6fb1124d4898b87c83f63ff6b5/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.836137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7225dc8ec43a4c0d9e7ce3acb9591bda, user_id=8c3b7e6fb1124d4898b87c83f63ff6b5, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.838877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.861053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1153/2321] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:19 2022] PUT /identity/v3/projects/7225dc8ec43a4c0d9e7ce3acb9591bda/users/8c3b7e6fb1124d4898b87c83f63ff6b5/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:19.873580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f98e5-6a3b-4489-80fc-99369680c349 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.874080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f98e5-6a3b-4489-80fc-99369680c349 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.874535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f98e5-6a3b-4489-80fc-99369680c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.907620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ad9f98e5-6a3b-4489-80fc-99369680c349 None None] MFA Rules not processed for user `8c3b7e6fb1124d4898b87c83f63ff6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:19.909396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ad9f98e5-6a3b-4489-80fc-99369680c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:20.014557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1169/2322] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:20.025902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.028255 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:20.102111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.143908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0caa6-d9d1-42e0-9f0e-5f51a386bd06 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.151060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d56cb1-b7e5-4706-adab-796975657fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.151854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d56cb1-b7e5-4706-adab-796975657fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.152199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d56cb1-b7e5-4706-adab-796975657fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.152521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d56cb1-b7e5-4706-adab-796975657fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.171301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d56cb1-b7e5-4706-adab-796975657fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.172954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d56cb1-b7e5-4706-adab-796975657fc7 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.203537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1154/2323] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:20.349014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f98e5-6a3b-4489-80fc-99369680c349 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.360667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f98e5-6a3b-4489-80fc-99369680c349 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.365175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.365997 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.366393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.366760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.438969 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.440785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.451858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1170/2324] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:29.553288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e0ff3-33a4-47b6-8f4f-13d3c73407ce None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:29.554268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e0ff3-33a4-47b6-8f4f-13d3c73407ce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:29.554734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e0ff3-33a4-47b6-8f4f-13d3c73407ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:29.581387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-015e0ff3-33a4-47b6-8f4f-13d3c73407ce None None] MFA Rules not processed for user `2691e1dc96e942b5ba4c726b72a835e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:29.583779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-015e0ff3-33a4-47b6-8f4f-13d3c73407ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:29.678445 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1155/2325] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:30.446896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:30.461608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:30.464650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:30.567497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245d613-0c7b-4f56-ac48-9b8e08f24f9e service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:30.574785 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba40887-ab27-4302-92aa-ec99a7426e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:30.575836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40887-ab27-4302-92aa-ec99a7426e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.576418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40887-ab27-4302-92aa-ec99a7426e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.576923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40887-ab27-4302-92aa-ec99a7426e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.580958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ba40887-ab27-4302-92aa-ec99a7426e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:30.601617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba40887-ab27-4302-92aa-ec99a7426e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:30.603510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba40887-ab27-4302-92aa-ec99a7426e34 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:30.613833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1171/2326] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:33.678592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849960b4-1889-484e-88d1-7e4893120d15 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.679446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849960b4-1889-484e-88d1-7e4893120d15 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.679609 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849960b4-1889-484e-88d1-7e4893120d15 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.682137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1156/2327] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:07:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:33.694901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b94a7-6230-4db3-be58-d0db1d1f565f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.695605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b94a7-6230-4db3-be58-d0db1d1f565f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.695605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b94a7-6230-4db3-be58-d0db1d1f565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.742912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-790b94a7-6230-4db3-be58-d0db1d1f565f None None] MFA Rules not processed for user `eadb39271321475ebb10382db43db0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:33.746554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-790b94a7-6230-4db3-be58-d0db1d1f565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:33.785175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1172/2328] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:07:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:33.809682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849960b4-1889-484e-88d1-7e4893120d15 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:33.812766 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-849960b4-1889-484e-88d1-7e4893120d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:33.869469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849960b4-1889-484e-88d1-7e4893120d15 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:33.915670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c149c4-ac76-4ec9-90ae-272ace5bb0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:33.916405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c149c4-ac76-4ec9-90ae-272ace5bb0be service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.916700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c149c4-ac76-4ec9-90ae-272ace5bb0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.917021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c149c4-ac76-4ec9-90ae-272ace5bb0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.939592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c149c4-ac76-4ec9-90ae-272ace5bb0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:33.944377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c149c4-ac76-4ec9-90ae-272ace5bb0be service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:33.986693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1157/2329] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:34.072980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cda32-3d71-4bc2-a9bf-6ad82025620f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.073272 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cda32-3d71-4bc2-a9bf-6ad82025620f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.073541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cda32-3d71-4bc2-a9bf-6ad82025620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.108350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-945cda32-3d71-4bc2-a9bf-6ad82025620f None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:34.111160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-945cda32-3d71-4bc2-a9bf-6ad82025620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:34.288518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1173/2330] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:07:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:34.289326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c98f6-264f-410b-913d-49551f335755 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.289830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c98f6-264f-410b-913d-49551f335755 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.290545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c98f6-264f-410b-913d-49551f335755 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.294956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1158/2331] 10.222.0.69 () {54 vars in 921 bytes} [Thu May 26 18:07:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:34.317759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b89de-303a-4c2c-b8ce-b2694a29aabc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.317759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b89de-303a-4c2c-b8ce-b2694a29aabc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.321983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b89de-303a-4c2c-b8ce-b2694a29aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.400872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c98f6-264f-410b-913d-49551f335755 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:34.405948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f40c98f6-264f-410b-913d-49551f335755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:34.410690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-be3b89de-303a-4c2c-b8ce-b2694a29aabc None None] MFA Rules not processed for user `9e36af3331a04e13b05fcbb8b2d9cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:34.413139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-be3b89de-303a-4c2c-b8ce-b2694a29aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:34.605216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1174/2332] 10.222.0.69 () {58 vars in 1018 bytes} [Thu May 26 18:07:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:34.631560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b89de-303a-4c2c-b8ce-b2694a29aabc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:34.646524 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b89de-303a-4c2c-b8ce-b2694a29aabc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:34.657981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:34.658817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.659582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.659915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.664357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c98f6-264f-410b-913d-49551f335755 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:34.677014 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:34.680693 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.681697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.681697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.684706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:34.686096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:34.715735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:34.721213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:34.723076 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1175/2333] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:07:34.786400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1159/2334] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:07:35.804395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.805937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:35.853270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42042642-ee3e-4f53-a0e1-b58baafbf030 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.876726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f3f51-9bbe-4209-a0b4-4084bb7c9828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.877409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f3f51-9bbe-4209-a0b4-4084bb7c9828 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.877699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f3f51-9bbe-4209-a0b4-4084bb7c9828 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.877985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f3f51-9bbe-4209-a0b4-4084bb7c9828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.888156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ef0f3f51-9bbe-4209-a0b4-4084bb7c9828 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:35.930341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f3f51-9bbe-4209-a0b4-4084bb7c9828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:35.935057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f3f51-9bbe-4209-a0b4-4084bb7c9828 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:35.967647 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1176/2335] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:07:38.781280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.927649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936f34a-2e12-4db1-a8d7-77a612c29ba1 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.939349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.941392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.941914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.942427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] PATH_INFO: `/v3/users/f8a0042fa00149f29bef5032608ee2d5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.945158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a0042fa00149f29bef5032608ee2d5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:38.949001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:38.956102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.070734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a0042fa00149f29bef5032608ee2d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:39.086923 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a0042fa00149f29bef5032608ee2d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:39.089400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a0042fa00149f29bef5032608ee2d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:39.090625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a0042fa00149f29bef5032608ee2d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:39.136109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a0042fa00149f29bef5032608ee2d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:39.163705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1160/2336] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:38 2022] DELETE /identity/v3/users/f8a0042fa00149f29bef5032608ee2d5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:39.169632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.170207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.170415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.191051 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.200227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:39.201791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:39.309106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1177/2337] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:39.327090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:39.329037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:39.466645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9d787-b7b8-4870-82db-39ff9d8cd51b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.473528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.474607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.475077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.476066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.506653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:39.510060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:39.545821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1161/2338] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:07:40.280249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:40.286986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:40.331707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d8a5-fa2d-45aa-aaa7-244c1eb3805f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:40.347364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:40.351715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:40.352810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:40.354876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] PATH_INFO: `/v3/projects/fe12777d7f4144e394b3fadafd232853` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:40.374961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe12777d7f4144e394b3fadafd232853)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:40.413252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:40.543998 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe12777d7f4144e394b3fadafd232853', 'request_id': 'req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.555777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe12777d7f4144e394b3fadafd232853', 'request_id': 'req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.575934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe12777d7f4144e394b3fadafd232853', 'request_id': 'req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.613137 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] The token cache is being invalidate because project fe12777d7f4144e394b3fadafd232853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:40.614063 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.615754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.625988 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:40.628457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1178/2339] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:40 2022] DELETE /identity/v3/projects/fe12777d7f4144e394b3fadafd232853 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:40.649576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e207-805e-418c-97c2-dc5d92b72b63 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:40.786215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:40.787659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:40.788234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:40.788729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] PATH_INFO: `/v3/users/8c3b7e6fb1124d4898b87c83f63ff6b5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:40.790602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3b7e6fb1124d4898b87c83f63ff6b5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:40.793169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:40.842436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:40.882786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3b7e6fb1124d4898b87c83f63ff6b5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.895703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3b7e6fb1124d4898b87c83f63ff6b5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.896667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3b7e6fb1124d4898b87c83f63ff6b5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.897528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3b7e6fb1124d4898b87c83f63ff6b5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.920575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b5c679cc-da09-4607-8147-e5f5d884c916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3b7e6fb1124d4898b87c83f63ff6b5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:40.954379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1162/2340] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:40 2022] DELETE /identity/v3/users/8c3b7e6fb1124d4898b87c83f63ff6b5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:41.863741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:41.866668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:41.920004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd480a7a-eb1f-4e39-a71a-2a2f9d17d895 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.116375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.117859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.118393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.118907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] PATH_INFO: `/v3/projects/7225dc8ec43a4c0d9e7ce3acb9591bda` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.121291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7225dc8ec43a4c0d9e7ce3acb9591bda)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.130281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.199561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:42.223954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7225dc8ec43a4c0d9e7ce3acb9591bda', 'request_id': 'req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:42.231971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7225dc8ec43a4c0d9e7ce3acb9591bda', 'request_id': 'req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:42.248079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7225dc8ec43a4c0d9e7ce3acb9591bda', 'request_id': 'req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:42.307282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] The token cache is being invalidate because project 7225dc8ec43a4c0d9e7ce3acb9591bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:42.308150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:42.310962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:42.314046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1179/2341] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:41 2022] DELETE /identity/v3/projects/7225dc8ec43a4c0d9e7ce3acb9591bda => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:42.321730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580965-d879-4e11-8a72-78387ed17f4a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.322321 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580965-d879-4e11-8a72-78387ed17f4a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.322858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99580965-d879-4e11-8a72-78387ed17f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.363094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-99580965-d879-4e11-8a72-78387ed17f4a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:42.365560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99580965-d879-4e11-8a72-78387ed17f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:42.398522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.399923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:42.482113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc4e53-7890-4dda-8083-d1ed7587ddc5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.488912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.489717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.490007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.490289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.492651 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:42.505530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1163/2342] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:42.516876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4ca3-cc6d-4097-83ca-b8c289588723 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.516876 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4ca3-cc6d-4097-83ca-b8c289588723 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.517236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4ca3-cc6d-4097-83ca-b8c289588723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.546305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9b2c4ca3-cc6d-4097-83ca-b8c289588723 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:42.548865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b2c4ca3-cc6d-4097-83ca-b8c289588723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:42.561113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1164/2343] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:42.565742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4ca3-cc6d-4097-83ca-b8c289588723 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.576462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4ca3-cc6d-4097-83ca-b8c289588723 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.584369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.585140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.585553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.585861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.586996 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:42.587450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.590448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.601433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.604227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.616472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1165/2344] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:42.617503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.629279 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe5878-025c-43b0-9c35-75066be739de admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.632470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1180/2345] 10.222.0.69 () {60 vars in 1396 bytes} [Thu May 26 18:07:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:07:42.642994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.646691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.649164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.649720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.651026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.659252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.750604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1166/2346] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:42 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:42.755128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.775629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9338c0b-25e6-4db5-aa0e-f1a067e8cecf service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.950124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.950997 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.951485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.951873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.953389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.955554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:43.016907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1181/2347] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:42 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:43.022432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:43.048295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8daa04-7528-401b-b4ef-f4396d5b9e43 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:43.052418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:43.053130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.053623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.053917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.054723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:43.056515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:43.069877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1167/2348] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:07:43.075256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:43.087904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:43.092299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d940fbe-51ce-4e81-a1e6-55538b427a0b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:43.100008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05a43-8411-4e96-933e-e2fde7e162a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:43.102835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05a43-8411-4e96-933e-e2fde7e162a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.103252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05a43-8411-4e96-933e-e2fde7e162a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.103638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05a43-8411-4e96-933e-e2fde7e162a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.104661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05a43-8411-4e96-933e-e2fde7e162a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:43.106577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05a43-8411-4e96-933e-e2fde7e162a1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:43.126531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1182/2349] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:43.128558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:43.140691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c745ec-3c40-4507-b30a-591590ec6410 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:43.146744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:43.147788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.148211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.148622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] PATH_INFO: `/v3/projects/b43ce8db0867424baa4fc1c0c2c9d18e/users/4910a4e2e32c402aad5458822d84386d/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.172350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43ce8db0867424baa4fc1c0c2c9d18e, user_id=4910a4e2e32c402aad5458822d84386d, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:43.175619 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:43.194249 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1168/2350] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:43 2022] PUT /identity/v3/projects/b43ce8db0867424baa4fc1c0c2c9d18e/users/4910a4e2e32c402aad5458822d84386d/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:43.206461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a276a72-e277-4e49-a23d-07170054d2ea None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.207377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a276a72-e277-4e49-a23d-07170054d2ea None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.208378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a276a72-e277-4e49-a23d-07170054d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.252358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9a276a72-e277-4e49-a23d-07170054d2ea None None] MFA Rules not processed for user `4910a4e2e32c402aad5458822d84386d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:43.253641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a276a72-e277-4e49-a23d-07170054d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:43.361587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1183/2351] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:43.363318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:43.411990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:43.489973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b44b-bfea-4738-81c1-c63ac2ca8bb0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:43.501624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:43.503548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.503548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.504162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.506043 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:43.511227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:43.592089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1169/2352] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:43 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:43.594055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a276a72-e277-4e49-a23d-07170054d2ea None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:43.613623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a276a72-e277-4e49-a23d-07170054d2ea None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:43.747153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:43.753849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.753849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.753849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.759880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:43.763741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:43.808549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1184/2353] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:43 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:07:43.813032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:43.831436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af9128-8f81-442b-b5d5-d8d84fb74e97 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:43.842514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:43.845415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.846476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.847242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.848652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:43.854030 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:43.879110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1170/2354] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:07:43.883491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:43.900512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fc308-5e2a-46a8-a3c4-a41165696e33 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:43.914799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:43.915742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.916008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.916315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] PATH_INFO: `/v3/projects/5a61c7d7745e4cfb91884e1e2655561e/users/2240a2f31feb4b23b2f4c00d7977409d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.972790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a61c7d7745e4cfb91884e1e2655561e, user_id=2240a2f31feb4b23b2f4c00d7977409d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:43.976493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:44.003727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1185/2355] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:43 2022] PUT /identity/v3/projects/5a61c7d7745e4cfb91884e1e2655561e/users/2240a2f31feb4b23b2f4c00d7977409d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:44.008898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.039655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b965b5-719e-4749-84e1-549197885586 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:44.204660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc288f84-ae57-4011-9639-b3be9d7d9814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:44.205906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc288f84-ae57-4011-9639-b3be9d7d9814 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.206602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc288f84-ae57-4011-9639-b3be9d7d9814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.206929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc288f84-ae57-4011-9639-b3be9d7d9814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.208661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc288f84-ae57-4011-9639-b3be9d7d9814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:44.211743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc288f84-ae57-4011-9639-b3be9d7d9814 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:44.252426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1171/2356] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:44.256639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.275601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c6265-e7bf-450a-b5ee-622ba7629503 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:44.281471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:44.282825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.283813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.283813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] PATH_INFO: `/v3/projects/5a61c7d7745e4cfb91884e1e2655561e/users/2240a2f31feb4b23b2f4c00d7977409d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.286293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a61c7d7745e4cfb91884e1e2655561e, user_id=2240a2f31feb4b23b2f4c00d7977409d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:44.289221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:44.308128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1186/2357] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:44 2022] PUT /identity/v3/projects/5a61c7d7745e4cfb91884e1e2655561e/users/2240a2f31feb4b23b2f4c00d7977409d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:44.321768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.322035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.322723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.369328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] MFA Rules not processed for user `2240a2f31feb4b23b2f4c00d7977409d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:44.373654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:44.561430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1172/2358] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:44.573770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.575724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:44.647580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:44.693973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9b8a5-6629-4522-8d1e-495f75a752ab admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:44.703301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:44.707033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.707501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.707992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.725705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:44.727310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:44.751084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1187/2359] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:44.831953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.834099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:44.875137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289eb40-cd4c-46ad-8862-1be7a007fda5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:44.881343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:44.882425 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.882940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.883382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.913263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.028083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:45.028083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:45.049048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1173/2360] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:49.220430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:49.223089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:49.496763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249af0b-9061-498a-a9fe-fda11560f8e2 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:49.525797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1763-4a25-45c6-abd9-caeb6cfd1988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:49.527079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1763-4a25-45c6-abd9-caeb6cfd1988 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:49.527606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1763-4a25-45c6-abd9-caeb6cfd1988 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:49.528529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1763-4a25-45c6-abd9-caeb6cfd1988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.561154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eaed1763-4a25-45c6-abd9-caeb6cfd1988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:49.611585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed1763-4a25-45c6-abd9-caeb6cfd1988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:49.613498 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed1763-4a25-45c6-abd9-caeb6cfd1988 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:49.644452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1188/2361] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:50.153891 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:50.332910 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50174643-f342-4632-8f6f-a5dcaa52eff8 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:50.348895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:50.349951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.350276 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.350541 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] PATH_INFO: `/v3/users/4910a4e2e32c402aad5458822d84386d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.352175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4910a4e2e32c402aad5458822d84386d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:50.354856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:50.447518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4910a4e2e32c402aad5458822d84386d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:50.460187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4910a4e2e32c402aad5458822d84386d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:50.460945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4910a4e2e32c402aad5458822d84386d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:50.462836 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4910a4e2e32c402aad5458822d84386d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:50.497567 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4910a4e2e32c402aad5458822d84386d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:50.575435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1174/2362] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:50 2022] DELETE /identity/v3/users/4910a4e2e32c402aad5458822d84386d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:50.580374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.581287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.581837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.634883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:50.640319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:50.868981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1189/2363] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:50.879953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:50.881493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:50.937744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:50.978863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686202e-8261-457e-ac81-4f1a69230464 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:50.985779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:50.986605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.986993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.987371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.004208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.006065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.034366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1175/2364] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:51.544617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.553959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:51.572926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4469-825c-4f67-9cf7-c36f4650f194 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.599668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.600825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.601218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.601813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] PATH_INFO: `/v3/projects/b43ce8db0867424baa4fc1c0c2c9d18e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.604457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43ce8db0867424baa4fc1c0c2c9d18e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.606710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.707319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43ce8db0867424baa4fc1c0c2c9d18e', 'request_id': 'req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:51.717060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43ce8db0867424baa4fc1c0c2c9d18e', 'request_id': 'req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:51.724050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:51.734671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43ce8db0867424baa4fc1c0c2c9d18e', 'request_id': 'req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:51.781562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] The token cache is being invalidate because project b43ce8db0867424baa4fc1c0c2c9d18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:51.782059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:51.783142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:51.804549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1190/2365] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:51 2022] DELETE /identity/v3/projects/b43ce8db0867424baa4fc1c0c2c9d18e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:51.805920 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.831423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0da2c1-5c6d-4658-98d2-d28a779b6f4a service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.029006 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.031426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.031718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.032073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] PATH_INFO: `/v3/users/2240a2f31feb4b23b2f4c00d7977409d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.033356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2240a2f31feb4b23b2f4c00d7977409d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:52.036783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:52.173067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2240a2f31feb4b23b2f4c00d7977409d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:52.203911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2240a2f31feb4b23b2f4c00d7977409d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:52.205521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2240a2f31feb4b23b2f4c00d7977409d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:52.207446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2240a2f31feb4b23b2f4c00d7977409d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:52.265579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ace8edbe-4a42-4e59-9ad2-1d13e4ef0080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2240a2f31feb4b23b2f4c00d7977409d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:52.312067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1176/2366] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:51 2022] DELETE /identity/v3/users/2240a2f31feb4b23b2f4c00d7977409d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:52.821091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:52.822557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:52.841718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4946b-8c84-41e1-b5a4-1b5e0ab2391e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.942471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.943373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.943664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.943943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] PATH_INFO: `/v3/projects/5a61c7d7745e4cfb91884e1e2655561e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.945414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a61c7d7745e4cfb91884e1e2655561e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:52.947389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.052676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a61c7d7745e4cfb91884e1e2655561e', 'request_id': 'req-7d3213b5-a2e9-40c5-adb6-51bef7a38446'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:53.064954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a61c7d7745e4cfb91884e1e2655561e', 'request_id': 'req-7d3213b5-a2e9-40c5-adb6-51bef7a38446'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:53.078683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a61c7d7745e4cfb91884e1e2655561e', 'request_id': 'req-7d3213b5-a2e9-40c5-adb6-51bef7a38446'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:53.099982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] The token cache is being invalidate because project 5a61c7d7745e4cfb91884e1e2655561e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:53.100417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:53.101496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d3213b5-a2e9-40c5-adb6-51bef7a38446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:53.104220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1191/2367] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:52 2022] DELETE /identity/v3/projects/5a61c7d7745e4cfb91884e1e2655561e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:53.111476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee89d6-b67b-4056-8581-570943d6e0a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.112273 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee89d6-b67b-4056-8581-570943d6e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.112273 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee89d6-b67b-4056-8581-570943d6e0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.136305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-95ee89d6-b67b-4056-8581-570943d6e0a0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:53.137723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-95ee89d6-b67b-4056-8581-570943d6e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:53.195992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:53.213049 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1177/2368] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:53.223144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085dbac-d898-40a9-8a84-7f26e92c4331 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.223427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085dbac-d898-40a9-8a84-7f26e92c4331 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.223707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085dbac-d898-40a9-8a84-7f26e92c4331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.245228 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2085dbac-d898-40a9-8a84-7f26e92c4331 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:53.246511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2085dbac-d898-40a9-8a84-7f26e92c4331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:53.256655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1192/2369] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:53.263167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee89d6-b67b-4056-8581-570943d6e0a0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.279304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee89d6-b67b-4056-8581-570943d6e0a0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.289216 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.290280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.290789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.291291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.292683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:53.293206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.297618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.325364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1178/2370] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:53.329502 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085dbac-d898-40a9-8a84-7f26e92c4331 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.340915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085dbac-d898-40a9-8a84-7f26e92c4331 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.349687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.350873 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.351402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.351976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.353209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.355408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.389796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1193/2371] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:07:53.394586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.406376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d2e7d-835b-453b-b058-0d30543dffab admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.495053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.496398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.496849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.497422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.498587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.503747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.537382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1179/2372] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:53.539117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.550130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6144e0-a7c5-48f2-9c13-071fa369f249 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.555001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.555669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.555973 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.556283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.557008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.558633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.570734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1194/2373] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:07:53.574822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.586356 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebee7fc-b16c-4902-ae7d-095433987826 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.591173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70221f-b953-43ee-a365-846059b3ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.591881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70221f-b953-43ee-a365-846059b3ba66 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.592849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70221f-b953-43ee-a365-846059b3ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.593353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70221f-b953-43ee-a365-846059b3ba66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.594708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70221f-b953-43ee-a365-846059b3ba66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.596701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70221f-b953-43ee-a365-846059b3ba66 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.608593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1180/2374] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:53.612748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.625420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36155-1d4f-4952-90ae-30fe4e3cd753 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.630308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.631207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.631485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.631761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] PATH_INFO: `/v3/projects/62c957859fb440c68467b9a31889b6ad/users/741fba52ba314c62b60d19cddaece4b9/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.651011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c957859fb440c68467b9a31889b6ad, user_id=741fba52ba314c62b60d19cddaece4b9, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.654021 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.675389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1195/2375] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:53 2022] PUT /identity/v3/projects/62c957859fb440c68467b9a31889b6ad/users/741fba52ba314c62b60d19cddaece4b9/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:53.689249 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7db782-d8fb-40dd-9f5b-d26c60e07d03 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.689587 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7db782-d8fb-40dd-9f5b-d26c60e07d03 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.689823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7db782-d8fb-40dd-9f5b-d26c60e07d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.720748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bd7db782-d8fb-40dd-9f5b-d26c60e07d03 None None] MFA Rules not processed for user `741fba52ba314c62b60d19cddaece4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:53.723822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd7db782-d8fb-40dd-9f5b-d26c60e07d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:53.819613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1181/2376] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:07:53.826008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.855611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:53.924628 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b4b83-3368-4d02-a7a2-692a86fee98f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.929733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.930419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.930705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.930983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.931687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.933716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.962871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1196/2377] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:53.968398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7db782-d8fb-40dd-9f5b-d26c60e07d03 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.980124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7db782-d8fb-40dd-9f5b-d26c60e07d03 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.028293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.045079 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.046314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.046606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.046901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.047728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.049717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.076252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1182/2378] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:54.081460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.093636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9de6-2e63-495f-96c2-486604e4a1e5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.099009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.099700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.099980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.100292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.101029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.102639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.118688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1197/2379] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:54.121643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.139862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a9f58-27c8-4c67-9fca-506dd4245c3a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.146568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.147475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.147763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.148080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] PATH_INFO: `/v3/projects/adaca5a900b4427ca9dc335c2ecaaa72/users/67f8a96700a449808b910258f087fb31/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.165400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=adaca5a900b4427ca9dc335c2ecaaa72, user_id=67f8a96700a449808b910258f087fb31, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.168156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.184913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1183/2380] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:54 2022] PUT /identity/v3/projects/adaca5a900b4427ca9dc335c2ecaaa72/users/67f8a96700a449808b910258f087fb31/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:54.191985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.217527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a90cd5-d304-4109-a259-104d91bd3dbd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.289745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed61b6-e195-4d8a-b784-df2a85ba0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.290445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed61b6-e195-4d8a-b784-df2a85ba0b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.290897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed61b6-e195-4d8a-b784-df2a85ba0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.291185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed61b6-e195-4d8a-b784-df2a85ba0b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.291930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed61b6-e195-4d8a-b784-df2a85ba0b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.293579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed61b6-e195-4d8a-b784-df2a85ba0b7a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.310776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1198/2381] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:54.313318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.325444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600879-1acc-4fd8-8ede-b079713b56ec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.332396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.333404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.333865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.334297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] PATH_INFO: `/v3/projects/adaca5a900b4427ca9dc335c2ecaaa72/users/67f8a96700a449808b910258f087fb31/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.336882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adaca5a900b4427ca9dc335c2ecaaa72, user_id=67f8a96700a449808b910258f087fb31, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.340002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.352300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1184/2382] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:54 2022] PUT /identity/v3/projects/adaca5a900b4427ca9dc335c2ecaaa72/users/67f8a96700a449808b910258f087fb31/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:54.366513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03f2b2-909f-451c-8ad7-5256c052d096 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.367623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03f2b2-909f-451c-8ad7-5256c052d096 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.367623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03f2b2-909f-451c-8ad7-5256c052d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.400778 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dd03f2b2-909f-451c-8ad7-5256c052d096 None None] MFA Rules not processed for user `67f8a96700a449808b910258f087fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:54.402142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dd03f2b2-909f-451c-8ad7-5256c052d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:54.493229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1199/2383] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:54.507396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.509329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:54.602628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4e898-56c0-48c1-a79c-3b64c508f240 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.607431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.608869 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.609535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.609924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.621817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.623593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.637363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1185/2384] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:54.737010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03f2b2-909f-451c-8ad7-5256c052d096 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.757794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03f2b2-909f-451c-8ad7-5256c052d096 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.767622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7219-2fde-4318-9aa0-2c5ade510f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.768801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7219-2fde-4318-9aa0-2c5ade510f7f service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.769415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7219-2fde-4318-9aa0-2c5ade510f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.770070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7219-2fde-4318-9aa0-2c5ade510f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.782433 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.878453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7219-2fde-4318-9aa0-2c5ade510f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.880716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7219-2fde-4318-9aa0-2c5ade510f7f service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.899034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1200/2385] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:55.310934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.391051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276615d-6657-40be-bbb6-c31f8e47bfa9 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.396295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.397236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.397522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.397797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] PATH_INFO: `/v3/users/741fba52ba314c62b60d19cddaece4b9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.399154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=741fba52ba314c62b60d19cddaece4b9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:55.401223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:55.460758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:55.463034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741fba52ba314c62b60d19cddaece4b9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:55.475171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741fba52ba314c62b60d19cddaece4b9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:55.476865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741fba52ba314c62b60d19cddaece4b9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:55.478266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741fba52ba314c62b60d19cddaece4b9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:55.504902 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741fba52ba314c62b60d19cddaece4b9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:55.525398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1186/2386] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:55 2022] DELETE /identity/v3/users/741fba52ba314c62b60d19cddaece4b9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:55.532904 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.533551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.534128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.565665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:55.567180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:55.632770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1201/2387] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:55.644844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.646927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:55.759178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47010040-e474-43cc-8549-86082d7271ca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.766389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.767417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.767929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.768467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.786126 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:55.788883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:55.807716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1187/2388] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:07:56.206004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.207484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:56.227199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6712c72-cf83-4dee-b8f7-139a2aa15f14 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.239644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.240611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.240901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.241388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] PATH_INFO: `/v3/projects/62c957859fb440c68467b9a31889b6ad` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.242724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c957859fb440c68467b9a31889b6ad)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.244891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.300388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c957859fb440c68467b9a31889b6ad', 'request_id': 'req-2ab9b201-01c5-40f8-8be8-19d2962e3e44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.308463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c957859fb440c68467b9a31889b6ad', 'request_id': 'req-2ab9b201-01c5-40f8-8be8-19d2962e3e44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.317734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c957859fb440c68467b9a31889b6ad', 'request_id': 'req-2ab9b201-01c5-40f8-8be8-19d2962e3e44'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.329835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] The token cache is being invalidate because project 62c957859fb440c68467b9a31889b6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:56.330135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.330810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.332454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1202/2389] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:56 2022] DELETE /identity/v3/projects/62c957859fb440c68467b9a31889b6ad => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:56.337418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.348113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2d9a-6a4e-447b-a1e7-510ab0e21cbd service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.423730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.424682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.424972 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.425268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] PATH_INFO: `/v3/users/67f8a96700a449808b910258f087fb31` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.426530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f8a96700a449808b910258f087fb31)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.428998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.482253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f8a96700a449808b910258f087fb31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.491405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f8a96700a449808b910258f087fb31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.492109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f8a96700a449808b910258f087fb31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.492798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f8a96700a449808b910258f087fb31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.504994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.507487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e604550b-5756-476b-a94d-1b3189e27c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f8a96700a449808b910258f087fb31'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:56.523220 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1188/2390] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:07:56 2022] DELETE /identity/v3/users/67f8a96700a449808b910258f087fb31 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:56.954578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.957155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:56.978888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9b201-01c5-40f8-8be8-19d2962e3e44 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.026800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.064293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.065173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.065556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.065836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] PATH_INFO: `/v3/projects/adaca5a900b4427ca9dc335c2ecaaa72` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.067223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=adaca5a900b4427ca9dc335c2ecaaa72)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.069256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.134119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adaca5a900b4427ca9dc335c2ecaaa72', 'request_id': 'req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:57.142834 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adaca5a900b4427ca9dc335c2ecaaa72', 'request_id': 'req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:57.152867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adaca5a900b4427ca9dc335c2ecaaa72', 'request_id': 'req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:57.166848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] The token cache is being invalidate because project adaca5a900b4427ca9dc335c2ecaaa72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:07:57.167326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:57.168450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-86a4afb3-9ec8-40a4-95c5-9d4b619de2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:07:57.171557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1203/2391] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:07:56 2022] DELETE /identity/v3/projects/adaca5a900b4427ca9dc335c2ecaaa72 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:57.177625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f343-f01f-4a5b-83bd-6af1833190c7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.177916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f343-f01f-4a5b-83bd-6af1833190c7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.178194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f343-f01f-4a5b-83bd-6af1833190c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.197960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3cd9f343-f01f-4a5b-83bd-6af1833190c7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:57.199190 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3cd9f343-f01f-4a5b-83bd-6af1833190c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:57.274879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1189/2392] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:57.282677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db642d-b0fc-4011-b9a6-1912e3e38899 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.283241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db642d-b0fc-4011-b9a6-1912e3e38899 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.283241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db642d-b0fc-4011-b9a6-1912e3e38899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.303773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-69db642d-b0fc-4011-b9a6-1912e3e38899 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:57.305056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69db642d-b0fc-4011-b9a6-1912e3e38899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:57.314371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1204/2393] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:57.318632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f343-f01f-4a5b-83bd-6af1833190c7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.329864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f343-f01f-4a5b-83bd-6af1833190c7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.334767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.335454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.335739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.336041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.336793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:57.337102 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.338758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.353038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1190/2394] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:57.357519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db642d-b0fc-4011-b9a6-1912e3e38899 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.367411 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db642d-b0fc-4011-b9a6-1912e3e38899 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.375469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.376226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.376504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.376784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.377555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.381527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.412294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1205/2395] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:57 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:57.416509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.429318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a272112-0fca-4bf7-a223-ab5b6436695d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.491473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.492196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.492482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.492762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.493481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.495437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.518502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1191/2396] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:57 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:57.522894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.535405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a07ed7-8a31-4d89-8983-d75824ee39d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.544140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.545284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.545996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.546590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.548154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.551316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.574694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1206/2397] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:57.578002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.589551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0006f-0c2b-4b3c-971b-7c7c710ded6e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.596171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bfba8-2e1e-414d-91c1-8394c65bb73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.597911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bfba8-2e1e-414d-91c1-8394c65bb73f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.597911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bfba8-2e1e-414d-91c1-8394c65bb73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.597911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bfba8-2e1e-414d-91c1-8394c65bb73f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.599027 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bfba8-2e1e-414d-91c1-8394c65bb73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.601499 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bfba8-2e1e-414d-91c1-8394c65bb73f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.618840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1192/2398] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:57.621195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.633636 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcedb0-d750-471b-ab9b-417646c3da30 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.638806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.641310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.642213 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.642572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] PATH_INFO: `/v3/projects/dd9d21420a614f28969623c110689f3a/users/b416881948024de7ac8ef72209a23fb9/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.661083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9d21420a614f28969623c110689f3a, user_id=b416881948024de7ac8ef72209a23fb9, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.663956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.680273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1207/2399] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:57 2022] PUT /identity/v3/projects/dd9d21420a614f28969623c110689f3a/users/b416881948024de7ac8ef72209a23fb9/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:57.691805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2432d1-e632-4c99-b985-c76d4de84a07 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.692123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2432d1-e632-4c99-b985-c76d4de84a07 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.692405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2432d1-e632-4c99-b985-c76d4de84a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.721665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5e2432d1-e632-4c99-b985-c76d4de84a07 None None] MFA Rules not processed for user `b416881948024de7ac8ef72209a23fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:57.723067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5e2432d1-e632-4c99-b985-c76d4de84a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:57.767700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.799858 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1193/2400] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:57.804867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.869461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.877476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516505-20eb-4ee8-b167-75ff2a3efa09 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.883708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.884465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.884759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.885112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.885815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.887860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.923294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1208/2401] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:07:57 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:57.927572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2432d1-e632-4c99-b985-c76d4de84a07 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.943579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2432d1-e632-4c99-b985-c76d4de84a07 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:58.005947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:58.006623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:58.006907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:58.007181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:58.007919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:58.009945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:58.030626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1194/2402] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:07:57 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:07:58.034802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:58.045083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28928562-1fc3-43fe-8ae6-fe1e399b38f1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:58.050392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:58.050996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:58.051281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:58.051560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:58.052331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:58.053928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:58.066173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1209/2403] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:58.070601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:58.081396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443ccd-a877-4ce8-8658-e490f55f8791 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:58.087365 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:58.088316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:58.088605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:58.088887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] PATH_INFO: `/v3/projects/13e807914e8f48b8afc870731e3712b6/users/458de528da5040598130553d20fe6421/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:58.107872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e807914e8f48b8afc870731e3712b6, user_id=458de528da5040598130553d20fe6421, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:58.111748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:58.126120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1195/2404] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:58 2022] PUT /identity/v3/projects/13e807914e8f48b8afc870731e3712b6/users/458de528da5040598130553d20fe6421/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:58.130353 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:58.140563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453219d-c452-4762-99b9-d3c62b1f5ec9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:58.204731 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460575d-3e85-40d6-9400-86270ad33463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:58.205420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460575d-3e85-40d6-9400-86270ad33463 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:58.205707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460575d-3e85-40d6-9400-86270ad33463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:58.205984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460575d-3e85-40d6-9400-86270ad33463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:58.206736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460575d-3e85-40d6-9400-86270ad33463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:58.208402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460575d-3e85-40d6-9400-86270ad33463 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:58.221996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1210/2405] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:07:58.227632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:58.244395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8f3fc-7073-4739-a035-8b7725149bcf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:58.252348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:58.253896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:58.254408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:58.254938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] PATH_INFO: `/v3/projects/13e807914e8f48b8afc870731e3712b6/users/458de528da5040598130553d20fe6421/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:58.258708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e807914e8f48b8afc870731e3712b6, user_id=458de528da5040598130553d20fe6421, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:58.261627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:58.277470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1196/2406] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:07:58 2022] PUT /identity/v3/projects/13e807914e8f48b8afc870731e3712b6/users/458de528da5040598130553d20fe6421/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:58.300334 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b2978-c62f-4925-a508-857eddbce8b5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:58.301078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b2978-c62f-4925-a508-857eddbce8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:58.301534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b2978-c62f-4925-a508-857eddbce8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:58.352583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-783b2978-c62f-4925-a508-857eddbce8b5 None None] MFA Rules not processed for user `458de528da5040598130553d20fe6421`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:58.354655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-783b2978-c62f-4925-a508-857eddbce8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:58.458950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1211/2407] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:07:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:07:58.472927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:58.474774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:58.564823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a298-5e4d-40eb-a6de-3d970aef5d9c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:58.569886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:58.571485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:58.571485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:58.571792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:58.634296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:58.652694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:58.654462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:58.667917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1197/2408] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:07:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:08:02.844038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12656873-0300-4fd2-bb55-3af4672e1d19 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.844652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12656873-0300-4fd2-bb55-3af4672e1d19 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.844652 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12656873-0300-4fd2-bb55-3af4672e1d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.864993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-12656873-0300-4fd2-bb55-3af4672e1d19 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:02.866269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-12656873-0300-4fd2-bb55-3af4672e1d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:02.923833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:02.934715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1212/2409] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:08:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:02.952117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:02.954130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:03.046728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7896d-3bc3-4c7b-a98f-884adb8eaea0 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:03.052074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:03.052761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:03.053048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:03.053328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:03.066386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:03.068065 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:03.078226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1198/2410] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:08:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:08:03.797528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12656873-0300-4fd2-bb55-3af4672e1d19 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:03.811906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12656873-0300-4fd2-bb55-3af4672e1d19 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:03.822117 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:03.823741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:03.824578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:03.824946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:03.850172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:03.850172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:03.878727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1213/2411] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:06.391968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.394259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:06.485174 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0b943-c681-4a73-b29d-b963fba70e63 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.490293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df1bff-cd14-4785-9195-e096e41e9861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.490959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df1bff-cd14-4785-9195-e096e41e9861 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.491346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df1bff-cd14-4785-9195-e096e41e9861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.491631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df1bff-cd14-4785-9195-e096e41e9861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.494798 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-10df1bff-cd14-4785-9195-e096e41e9861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:06.600459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df1bff-cd14-4785-9195-e096e41e9861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.602285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df1bff-cd14-4785-9195-e096e41e9861 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.617493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1199/2412] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:09.329401 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.349211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77111f-dadf-4e8c-b3d2-ad101581838e service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.355746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.357792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.358771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.359896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] PATH_INFO: `/v3/users/b416881948024de7ac8ef72209a23fb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.361698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b416881948024de7ac8ef72209a23fb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.364395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.449083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b416881948024de7ac8ef72209a23fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:09.468530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b416881948024de7ac8ef72209a23fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:09.480810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b416881948024de7ac8ef72209a23fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:09.501225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b416881948024de7ac8ef72209a23fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:09.504487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b416881948024de7ac8ef72209a23fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:09.518992 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1214/2413] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:09 2022] DELETE /identity/v3/users/b416881948024de7ac8ef72209a23fb9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:09.524648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.525245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.525671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.550967 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:09.552405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:09.588717 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:09.677622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1200/2414] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:09.694787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.696516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:09.892147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac151dfe-482c-44ac-9f12-383716bcb290 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.903430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.905704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.906044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.906346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.933151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.934644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.966136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1215/2415] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:10.759982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:10.765325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:10.791390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020b96d-f5fe-4d7e-a3e0-5e8eae84bb7b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:10.800664 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:10.801554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:10.801841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:10.802326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] PATH_INFO: `/v3/projects/dd9d21420a614f28969623c110689f3a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:10.803555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9d21420a614f28969623c110689f3a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:10.808285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:10.942150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9d21420a614f28969623c110689f3a', 'request_id': 'req-1516aba4-cc61-46f6-9943-d58f0a171c24'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:10.970203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9d21420a614f28969623c110689f3a', 'request_id': 'req-1516aba4-cc61-46f6-9943-d58f0a171c24'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:10.991085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9d21420a614f28969623c110689f3a', 'request_id': 'req-1516aba4-cc61-46f6-9943-d58f0a171c24'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.020056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] The token cache is being invalidate because project dd9d21420a614f28969623c110689f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:11.020056 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.020373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.022480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1201/2416] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:10 2022] DELETE /identity/v3/projects/dd9d21420a614f28969623c110689f3a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:11.026582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:11.059527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e618a-403e-4908-8a1f-95b884afaa86 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:11.277041 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:11.277991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.278267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.278548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] PATH_INFO: `/v3/users/458de528da5040598130553d20fe6421` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.284914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=458de528da5040598130553d20fe6421)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:11.293186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:11.301044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:11.399768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458de528da5040598130553d20fe6421'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.434872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458de528da5040598130553d20fe6421'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.451966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458de528da5040598130553d20fe6421'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.475890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458de528da5040598130553d20fe6421'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.480600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458de528da5040598130553d20fe6421'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:11.505928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1216/2417] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:11 2022] DELETE /identity/v3/users/458de528da5040598130553d20fe6421 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:08:11.998600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:11.998600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:12.011379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516aba4-cc61-46f6-9943-d58f0a171c24 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.118519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.119959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.120294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.120621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] PATH_INFO: `/v3/projects/13e807914e8f48b8afc870731e3712b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.122413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e807914e8f48b8afc870731e3712b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.126334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.181744 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.183752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:12.201830 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a615a1-7e46-4fa0-ae40-8547b8dbedfd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.209214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e807914e8f48b8afc870731e3712b6', 'request_id': 'req-c86b4240-f319-4e63-b8b9-5bea4caad3a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.212613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.219841 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e807914e8f48b8afc870731e3712b6', 'request_id': 'req-c86b4240-f319-4e63-b8b9-5bea4caad3a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.228630 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e807914e8f48b8afc870731e3712b6', 'request_id': 'req-c86b4240-f319-4e63-b8b9-5bea4caad3a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.245324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] The token cache is being invalidate because project 13e807914e8f48b8afc870731e3712b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:12.245627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.246429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c86b4240-f319-4e63-b8b9-5bea4caad3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.249441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1202/2418] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:11 2022] DELETE /identity/v3/projects/13e807914e8f48b8afc870731e3712b6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:12.257192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e499-14eb-43cf-8220-3d39fce745dd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.257595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e499-14eb-43cf-8220-3d39fce745dd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.257954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e499-14eb-43cf-8220-3d39fce745dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.282639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-05a0e499-14eb-43cf-8220-3d39fce745dd None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:12.285344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-05a0e499-14eb-43cf-8220-3d39fce745dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:12.297154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.298105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.298402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.298726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] PATH_INFO: `/v3/users/a95761f42af64635b051051e397d0fd1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.300185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95761f42af64635b051051e397d0fd1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.302301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.360305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95761f42af64635b051051e397d0fd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.362497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1203/2419] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:12.371409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf95fc-0e8f-46b8-afd0-d1fcb5779298 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.371697 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf95fc-0e8f-46b8-afd0-d1fcb5779298 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.371980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf95fc-0e8f-46b8-afd0-d1fcb5779298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.375605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95761f42af64635b051051e397d0fd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.384561 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95761f42af64635b051051e397d0fd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.392951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95761f42af64635b051051e397d0fd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.393302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ecf95fc-0e8f-46b8-afd0-d1fcb5779298 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:12.393659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95761f42af64635b051051e397d0fd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.394562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ecf95fc-0e8f-46b8-afd0-d1fcb5779298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:12.395370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.403638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1217/2420] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:12 2022] DELETE /identity/v3/users/a95761f42af64635b051051e397d0fd1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:08:12.405723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1204/2421] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:12.410130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.504578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fbc59-972c-4978-b563-58cf46c7e261 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.514306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.515132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.515644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.516207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.517642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:12.518158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.521262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.546478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1218/2422] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:12.553141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf95fc-0e8f-46b8-afd0-d1fcb5779298 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.564651 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf95fc-0e8f-46b8-afd0-d1fcb5779298 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.569103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.570016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.570161 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.570342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.575385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.575385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.607653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1205/2423] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:12 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:12.609551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.623594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220706df-3746-4e74-a8c9-d7ee877e9bca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.697548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.698455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.698860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.699271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.700090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.702837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.729730 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1219/2424] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:12 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:12.737483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.737682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.739889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:12.762225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634bcf6-6848-4b10-8ed7-3f5555aa92f7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.767247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e4584-07df-4a5b-b31d-d948a0149b79 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.770941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.771900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.772231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.772519 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] PATH_INFO: `/v3/projects/79f8f4d1e7da4bfe9629717a86ba0def` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.774107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f8f4d1e7da4bfe9629717a86ba0def)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.775929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.776288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.776686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.776979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.777266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.778023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.779811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.802882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1206/2425] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:12.808795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.821678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df54f1-91d3-463b-9118-43d986b04fe9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.829008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.829971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.830416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.830809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.831721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.833786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.849417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1207/2426] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:08:12.850486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f8f4d1e7da4bfe9629717a86ba0def', 'request_id': 'req-885c73d4-9f55-415d-a165-8422da1ffd3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.858012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.860423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f8f4d1e7da4bfe9629717a86ba0def', 'request_id': 'req-885c73d4-9f55-415d-a165-8422da1ffd3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.870179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f8f4d1e7da4bfe9629717a86ba0def', 'request_id': 'req-885c73d4-9f55-415d-a165-8422da1ffd3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.879637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bbb73-d3c4-42bc-9e53-d4c0189df757 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.885569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] The token cache is being invalidate because project 79f8f4d1e7da4bfe9629717a86ba0def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:12.885953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.886642 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-885c73d4-9f55-415d-a165-8422da1ffd3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:12.888780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1220/2427] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:12 2022] DELETE /identity/v3/projects/79f8f4d1e7da4bfe9629717a86ba0def => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:12.895938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5acd-2056-465b-9314-45ffed820974 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.896418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5acd-2056-465b-9314-45ffed820974 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.896806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5acd-2056-465b-9314-45ffed820974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.904690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.920095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d87b5acd-2056-465b-9314-45ffed820974 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:12.922627 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d87b5acd-2056-465b-9314-45ffed820974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:12.957183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33016f28-2aa6-4ab4-a949-dc9564f3f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.958129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016f28-2aa6-4ab4-a949-dc9564f3f056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.958408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016f28-2aa6-4ab4-a949-dc9564f3f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.958685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016f28-2aa6-4ab4-a949-dc9564f3f056 admin admin] PATH_INFO: `/v3/projects/3928374a42f44f928d0882308d014ecd/users/3ab0f9f48fc04747a8a12437592e3612/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.978625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33016f28-2aa6-4ab4-a949-dc9564f3f056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3928374a42f44f928d0882308d014ecd, user_id=3ab0f9f48fc04747a8a12437592e3612, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.984404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33016f28-2aa6-4ab4-a949-dc9564f3f056 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.007953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1221/2428] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:13.008289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1208/2429] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:12 2022] PUT /identity/v3/projects/3928374a42f44f928d0882308d014ecd/users/3ab0f9f48fc04747a8a12437592e3612/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:13.013000 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa846a-5a02-47ae-b5bf-06d1c5291e6a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.013760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa846a-5a02-47ae-b5bf-06d1c5291e6a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.014151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa846a-5a02-47ae-b5bf-06d1c5291e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.025687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.026253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.026562 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.049028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2baa846a-5a02-47ae-b5bf-06d1c5291e6a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:13.052177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2baa846a-5a02-47ae-b5bf-06d1c5291e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:13.062195 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.066977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] MFA Rules not processed for user `3ab0f9f48fc04747a8a12437592e3612`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:13.069001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:13.132967 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1222/2430] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:13.134382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa846a-5a02-47ae-b5bf-06d1c5291e6a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.146328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa846a-5a02-47ae-b5bf-06d1c5291e6a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.152735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.153415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.153771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.155161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.155971 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:13.156298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.157935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.170645 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1223/2431] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:13.175241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.175887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1209/2432] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:13.186096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba13f63-1820-4977-96d9-0a345187aaf7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.189211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.190643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:13.191003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.191666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.191954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.192273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.193038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.194930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.223052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1224/2433] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:13 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:13.227262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.256855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fb3b-55b3-414b-986e-178a45b640d4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.290292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a17b-6c72-44a2-b844-067c1ce853d3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.295874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.296619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.296910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.297194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.297882 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.299809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.307285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.307939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.308280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.308549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.316367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.321839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1225/2434] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:13 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:13.326553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.335937 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9fbb-0865-4b18-93a8-feb933bb6ce9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.341840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.342783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.342783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.343343 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.344128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.345734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.356141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1226/2435] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:13.360930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.370585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d2ec-3d16-4afa-b494-11e6fdabc820 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.375281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e26abd-f8c6-478b-83b8-b097e830d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.375468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.375944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26abd-f8c6-478b-83b8-b097e830d5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.376270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26abd-f8c6-478b-83b8-b097e830d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.376555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26abd-f8c6-478b-83b8-b097e830d5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.376977 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.377291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e26abd-f8c6-478b-83b8-b097e830d5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.378889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e26abd-f8c6-478b-83b8-b097e830d5bc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.386192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1210/2436] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:08:13.390777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1227/2437] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:13.394842 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.409260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe058af-903c-4a36-b149-ec6d06ae61a6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.415585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.416707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.417002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.417287 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] PATH_INFO: `/v3/projects/2d8a7527f46d4e0d8d8fb538353a4ab1/users/b0acebd9631b4f2ca18c2463da2c7d03/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.430343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.435400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8a7527f46d4e0d8d8fb538353a4ab1, user_id=b0acebd9631b4f2ca18c2463da2c7d03, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.438685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.453469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1211/2438] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:13 2022] PUT /identity/v3/projects/2d8a7527f46d4e0d8d8fb538353a4ab1/users/b0acebd9631b4f2ca18c2463da2c7d03/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:13.464367 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.464663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.464949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.494304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] MFA Rules not processed for user `b0acebd9631b4f2ca18c2463da2c7d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:13.495803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:13.564892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1228/2439] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:13.576809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.578859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:13.664640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2216090-67a9-486f-b795-e7d8f9e4c194 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.671990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b138701-3c7c-4b9f-bb7e-50c6835cf774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.672861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b138701-3c7c-4b9f-bb7e-50c6835cf774 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.673032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b138701-3c7c-4b9f-bb7e-50c6835cf774 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.673323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b138701-3c7c-4b9f-bb7e-50c6835cf774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.684238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b138701-3c7c-4b9f-bb7e-50c6835cf774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.687415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b138701-3c7c-4b9f-bb7e-50c6835cf774 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.703585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1212/2440] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:22.699198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.701313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:22.767972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd73f4-cf7d-4c68-a161-6aedd8291aad None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.772675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.773552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.773835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.774108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] PATH_INFO: `/v3/users/3ab0f9f48fc04747a8a12437592e3612` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.775296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab0f9f48fc04747a8a12437592e3612)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.777329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.825618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab0f9f48fc04747a8a12437592e3612'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:22.837390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab0f9f48fc04747a8a12437592e3612'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:22.841783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.847135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab0f9f48fc04747a8a12437592e3612'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:22.858128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab0f9f48fc04747a8a12437592e3612'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:22.858868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab0f9f48fc04747a8a12437592e3612'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:22.865240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1229/2441] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:22 2022] DELETE /identity/v3/users/3ab0f9f48fc04747a8a12437592e3612 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:22.870052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3e6f-cf15-4da5-b6bd-bc026266d45f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.870594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3e6f-cf15-4da5-b6bd-bc026266d45f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.870698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3e6f-cf15-4da5-b6bd-bc026266d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.888518 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e20e3e6f-cf15-4da5-b6bd-bc026266d45f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:22.889757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e20e3e6f-cf15-4da5-b6bd-bc026266d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:22.957004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1213/2442] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:22.968258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.969693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:23.036956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcce14-1c8c-4356-bc92-893075010576 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.040713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.041378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.041663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.041945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.052749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.054325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.067054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1230/2443] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:23.347879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.348213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.348807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.372995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:23.375528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:23.479282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1214/2444] 10.222.0.69 () {58 vars in 967 bytes} [Thu May 26 18:08:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:23.491927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.494426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:23.504055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.506859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:23.515317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cfc10-1ccf-48b9-a6eb-825090a6e8ba service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.525941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.527579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.527579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.529460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] PATH_INFO: `/v3/projects/3928374a42f44f928d0882308d014ecd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.531939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3928374a42f44f928d0882308d014ecd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.537259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.561818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.640615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3928374a42f44f928d0882308d014ecd', 'request_id': 'req-64dc0ade-e87f-43d2-a864-078c529f99a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:23.648448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ae7e9-d32b-4c1b-ab35-3312474a67d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.653008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3928374a42f44f928d0882308d014ecd', 'request_id': 'req-64dc0ade-e87f-43d2-a864-078c529f99a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:23.666415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3928374a42f44f928d0882308d014ecd', 'request_id': 'req-64dc0ade-e87f-43d2-a864-078c529f99a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:23.682792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] The token cache is being invalidate because project 3928374a42f44f928d0882308d014ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:23.683150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:23.683811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:23.686428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1231/2445] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:23 2022] DELETE /identity/v3/projects/3928374a42f44f928d0882308d014ecd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:23.756124 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10745ad-067a-4ce2-b06a-dd257ac4552c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.759473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10745ad-067a-4ce2-b06a-dd257ac4552c service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.760303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10745ad-067a-4ce2-b06a-dd257ac4552c service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.760303 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10745ad-067a-4ce2-b06a-dd257ac4552c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.763943 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a10745ad-067a-4ce2-b06a-dd257ac4552c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:23.868799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10745ad-067a-4ce2-b06a-dd257ac4552c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.870677 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10745ad-067a-4ce2-b06a-dd257ac4552c service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.881170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1215/2446] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:08:24.490994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.490994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:24.556764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc0ade-e87f-43d2-a864-078c529f99a0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.562365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.563247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.564176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.564176 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] PATH_INFO: `/v3/users/b0acebd9631b4f2ca18c2463da2c7d03` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.565261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0acebd9631b4f2ca18c2463da2c7d03)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.567276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.585112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:24.621182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0acebd9631b4f2ca18c2463da2c7d03'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:24.635377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0acebd9631b4f2ca18c2463da2c7d03'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:24.643764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0acebd9631b4f2ca18c2463da2c7d03'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:24.651701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0acebd9631b4f2ca18c2463da2c7d03'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:24.652626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0acebd9631b4f2ca18c2463da2c7d03'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:24.660044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1232/2447] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:24 2022] DELETE /identity/v3/users/b0acebd9631b4f2ca18c2463da2c7d03 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:24.665186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.665708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.666149 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.686219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:24.687473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:24.777436 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1216/2448] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:24.787557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.789127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:24.878023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916265a-2132-4d5b-a92b-238353a68b16 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.884550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71fb0f-aa51-4387-8668-b4b0a7e9a607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.885720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71fb0f-aa51-4387-8668-b4b0a7e9a607 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.886231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71fb0f-aa51-4387-8668-b4b0a7e9a607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.886755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71fb0f-aa51-4387-8668-b4b0a7e9a607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.905527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71fb0f-aa51-4387-8668-b4b0a7e9a607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.907020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71fb0f-aa51-4387-8668-b4b0a7e9a607 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.920745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1233/2449] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:25.225705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.227231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:25.237642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.241975 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b758d-7d5a-4777-8c9a-250f4eb6567e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.248477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.249343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.249658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.249941 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] PATH_INFO: `/v3/projects/2d8a7527f46d4e0d8d8fb538353a4ab1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.251266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8a7527f46d4e0d8d8fb538353a4ab1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.253248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.311455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8a7527f46d4e0d8d8fb538353a4ab1', 'request_id': 'req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:25.320601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8a7527f46d4e0d8d8fb538353a4ab1', 'request_id': 'req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:25.328300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8a7527f46d4e0d8d8fb538353a4ab1', 'request_id': 'req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:25.343154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] The token cache is being invalidate because project 2d8a7527f46d4e0d8d8fb538353a4ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:25.343433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:25.344223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f80339a-3a5e-4d71-9b1a-33eaeed29c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:25.345830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1217/2450] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:25 2022] DELETE /identity/v3/projects/2d8a7527f46d4e0d8d8fb538353a4ab1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:25.351210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce40a-c82a-4e42-993e-f637262bc85f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.351501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce40a-c82a-4e42-993e-f637262bc85f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.351789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce40a-c82a-4e42-993e-f637262bc85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.371554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3c2ce40a-c82a-4e42-993e-f637262bc85f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:25.373262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c2ce40a-c82a-4e42-993e-f637262bc85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:25.460438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1234/2451] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:25.471058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dc3e7-0b23-44c5-b229-409a398a3e0a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.471345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dc3e7-0b23-44c5-b229-409a398a3e0a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.471721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dc3e7-0b23-44c5-b229-409a398a3e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.497966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3f6dc3e7-0b23-44c5-b229-409a398a3e0a None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:25.499241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f6dc3e7-0b23-44c5-b229-409a398a3e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:25.508212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1218/2452] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:25.512503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ce40a-c82a-4e42-993e-f637262bc85f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.523914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ce40a-c82a-4e42-993e-f637262bc85f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.529109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.530145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.530436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.530715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.531469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:25.531782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.533510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.547938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1235/2453] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:25.552699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dc3e7-0b23-44c5-b229-409a398a3e0a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.563061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dc3e7-0b23-44c5-b229-409a398a3e0a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.567980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.568670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.568987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.569227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.569921 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.571831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.602036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1219/2454] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:25 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:25.607587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.618509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7dbb-f91c-43ac-a1e3-86f0d4ea3ce9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.641305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.689966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.690720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.691040 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.691327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.692101 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.694065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.717521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1236/2455] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:25 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:25.721673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.733906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1cdf1-8781-4dd7-aa60-a437b9fbb7a8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.739583 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.740310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.740602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.740877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.741622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.743906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.762760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1220/2456] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:25.766723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.784634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f1dbf-4fd3-4339-9106-b9b32af36e69 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.791081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ad6b6-a75f-4d1c-920f-ab070561b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.791806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ad6b6-a75f-4d1c-920f-ab070561b369 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.792109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ad6b6-a75f-4d1c-920f-ab070561b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.792397 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ad6b6-a75f-4d1c-920f-ab070561b369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.793143 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ad6b6-a75f-4d1c-920f-ab070561b369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.795547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ad6b6-a75f-4d1c-920f-ab070561b369 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.807670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1237/2457] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:08:25.813433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.824656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742cc89-ff7a-4fcf-9998-3dfa847f033f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.829978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.830879 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.831162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.832188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] PATH_INFO: `/v3/projects/a52b7beda16e4abfbf0914a52678ce5e/users/1b73a7943c544e2394a20fd6fcb29aeb/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.849965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52b7beda16e4abfbf0914a52678ce5e, user_id=1b73a7943c544e2394a20fd6fcb29aeb, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.853495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.873809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1221/2458] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:25 2022] PUT /identity/v3/projects/a52b7beda16e4abfbf0914a52678ce5e/users/1b73a7943c544e2394a20fd6fcb29aeb/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:25.886324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2519-dd07-4f1e-a2d1-4e541808288e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.886621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2519-dd07-4f1e-a2d1-4e541808288e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.886905 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2519-dd07-4f1e-a2d1-4e541808288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.917292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1b4c2519-dd07-4f1e-a2d1-4e541808288e None None] MFA Rules not processed for user `1b73a7943c544e2394a20fd6fcb29aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:25.918671 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1b4c2519-dd07-4f1e-a2d1-4e541808288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:25.995209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1238/2459] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:26.008285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:26.010130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:26.093297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804ee1-7afd-429c-8ea2-7e3c813ada5a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:26.098965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd394a-fd1b-46eb-8c36-777d9a8e230c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:26.099634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd394a-fd1b-46eb-8c36-777d9a8e230c service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.099986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd394a-fd1b-46eb-8c36-777d9a8e230c service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.100320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd394a-fd1b-46eb-8c36-777d9a8e230c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.110824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd394a-fd1b-46eb-8c36-777d9a8e230c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:26.112477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd394a-fd1b-46eb-8c36-777d9a8e230c service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:26.122523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1222/2460] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:26.345511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c2519-dd07-4f1e-a2d1-4e541808288e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:26.409165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c2519-dd07-4f1e-a2d1-4e541808288e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:26.421106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:26.422006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.422295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.422577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] PATH_INFO: `/v3/users/1b73a7943c544e2394a20fd6fcb29aeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.423837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b73a7943c544e2394a20fd6fcb29aeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:26.425862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:26.465585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:26.484375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b73a7943c544e2394a20fd6fcb29aeb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:26.498682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b73a7943c544e2394a20fd6fcb29aeb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:26.505759 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b73a7943c544e2394a20fd6fcb29aeb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:26.512713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b73a7943c544e2394a20fd6fcb29aeb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:26.514419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b73a7943c544e2394a20fd6fcb29aeb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:26.520690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1239/2461] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:26 2022] DELETE /identity/v3/users/1b73a7943c544e2394a20fd6fcb29aeb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:26.524969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.525397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.525528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.545467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:26.546679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:26.550740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:26.612763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1223/2462] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:26.623428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:26.624919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:26.686330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a279-71b4-45af-b507-cf2299ceb84e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:26.690185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149212e3-f306-4514-9d29-a0250b9faf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:26.690840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149212e3-f306-4514-9d29-a0250b9faf55 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.691118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149212e3-f306-4514-9d29-a0250b9faf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.691396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149212e3-f306-4514-9d29-a0250b9faf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.701850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149212e3-f306-4514-9d29-a0250b9faf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:26.703295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149212e3-f306-4514-9d29-a0250b9faf55 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:26.713211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1240/2463] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:27.002113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.003863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:27.024469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776831-cdb7-4634-9c2a-ce57172fb6e3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.032953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.034655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.035263 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.035640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] PATH_INFO: `/v3/projects/a52b7beda16e4abfbf0914a52678ce5e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.037951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52b7beda16e4abfbf0914a52678ce5e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.041837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.106269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52b7beda16e4abfbf0914a52678ce5e', 'request_id': 'req-7749f60c-8585-4443-bf72-b493b8b4ce04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:27.113924 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52b7beda16e4abfbf0914a52678ce5e', 'request_id': 'req-7749f60c-8585-4443-bf72-b493b8b4ce04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:27.123265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52b7beda16e4abfbf0914a52678ce5e', 'request_id': 'req-7749f60c-8585-4443-bf72-b493b8b4ce04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:27.143580 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] The token cache is being invalidate because project a52b7beda16e4abfbf0914a52678ce5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:27.144141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:27.145221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7749f60c-8585-4443-bf72-b493b8b4ce04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:27.147037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1224/2464] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:27 2022] DELETE /identity/v3/projects/a52b7beda16e4abfbf0914a52678ce5e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:27.151946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322d3bf-87fe-4a3e-98dc-d1e31018a780 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.152271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322d3bf-87fe-4a3e-98dc-d1e31018a780 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.152552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322d3bf-87fe-4a3e-98dc-d1e31018a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.171554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2322d3bf-87fe-4a3e-98dc-d1e31018a780 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:27.172878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2322d3bf-87fe-4a3e-98dc-d1e31018a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:27.236815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1241/2465] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:27.245935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ef55-389f-46ef-8128-9ad372c42da4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.246225 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ef55-389f-46ef-8128-9ad372c42da4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.246537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ef55-389f-46ef-8128-9ad372c42da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.268655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8ab3ef55-389f-46ef-8128-9ad372c42da4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:27.269999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8ab3ef55-389f-46ef-8128-9ad372c42da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:27.278797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1225/2466] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:27.283149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322d3bf-87fe-4a3e-98dc-d1e31018a780 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.293702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322d3bf-87fe-4a3e-98dc-d1e31018a780 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.298894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.299591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.299881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.300191 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.300947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:27.301259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.302879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.316304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1242/2467] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:27.320543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ef55-389f-46ef-8128-9ad372c42da4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.330807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ef55-389f-46ef-8128-9ad372c42da4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.335634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.336369 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.336654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.336934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.337650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.339586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.380495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1226/2468] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:27.385373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.401727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622c66a-40b4-487d-bb42-19198df67e6a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.450324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.479958 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.480687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.480979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.481265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.482105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.484506 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.511425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1243/2469] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:27.514192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.525019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817c15d-65f3-4080-9245-cac0db3e3c01 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.533236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.534575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.535083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.535631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.537080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.540294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.556899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1227/2470] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:27.562806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.573943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb77a0-7dea-4ba5-bbac-3bd850270140 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.579825 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ef1ae-ad8d-445c-bac5-b11fcb7fea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.580599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef1ae-ad8d-445c-bac5-b11fcb7fea97 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.580889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef1ae-ad8d-445c-bac5-b11fcb7fea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.581169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef1ae-ad8d-445c-bac5-b11fcb7fea97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.581920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ef1ae-ad8d-445c-bac5-b11fcb7fea97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.583635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ef1ae-ad8d-445c-bac5-b11fcb7fea97 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.595659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1244/2471] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:27.600570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.612209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cef1e-4887-44cb-a3bd-a697b12cc97d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.617361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.618300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.618591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.618874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] PATH_INFO: `/v3/projects/91e0fa6bc6b949f6b433f4b9fa7d0047/users/5265006421e54e8f87674a88421416ba/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.637116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e0fa6bc6b949f6b433f4b9fa7d0047, user_id=5265006421e54e8f87674a88421416ba, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.639970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.660048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1228/2472] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:27 2022] PUT /identity/v3/projects/91e0fa6bc6b949f6b433f4b9fa7d0047/users/5265006421e54e8f87674a88421416ba/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:27.672931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0b68-644d-41f6-a8f3-12c5b988e303 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.673426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0b68-644d-41f6-a8f3-12c5b988e303 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.673927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0b68-644d-41f6-a8f3-12c5b988e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.706430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b7ab0b68-644d-41f6-a8f3-12c5b988e303 None None] MFA Rules not processed for user `5265006421e54e8f87674a88421416ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:27.707732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b7ab0b68-644d-41f6-a8f3-12c5b988e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:27.790016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1245/2473] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:27.795742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.833322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.866516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fe04-5bc6-4d06-87a1-4289e7a0fb82 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.871277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.871944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.872260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.873082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.873939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.875739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.902213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1229/2474] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:27.906602 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0b68-644d-41f6-a8f3-12c5b988e303 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.917531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0b68-644d-41f6-a8f3-12c5b988e303 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.977557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.978242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.978535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.978809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.979512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.981488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.004981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1246/2475] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:28.009150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.021392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6d81f-91ff-4064-a28e-23e1bd97f555 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.026246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.026932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.027217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.027495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.028271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.030494 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.042285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1230/2476] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:28.047748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.057986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55135f-0615-49ff-b2a8-6b6067ecf42e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.062919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.063814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.064138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.064420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] PATH_INFO: `/v3/projects/aee5b78c7c7e4563a4c626e9c03f8b1d/users/900f690a25f74308bfdb3ed915c2ce2d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.082141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee5b78c7c7e4563a4c626e9c03f8b1d, user_id=900f690a25f74308bfdb3ed915c2ce2d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.084941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.099985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1247/2477] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:28 2022] PUT /identity/v3/projects/aee5b78c7c7e4563a4c626e9c03f8b1d/users/900f690a25f74308bfdb3ed915c2ce2d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:28.104268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.115443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce088e9-705c-470c-afa4-ef50ec56810a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.172940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647d8f4-eabd-459c-8ee8-ba67ec18faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.173624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647d8f4-eabd-459c-8ee8-ba67ec18faa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.173911 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647d8f4-eabd-459c-8ee8-ba67ec18faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.174192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647d8f4-eabd-459c-8ee8-ba67ec18faa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.174934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647d8f4-eabd-459c-8ee8-ba67ec18faa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.176660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647d8f4-eabd-459c-8ee8-ba67ec18faa6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.187462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1231/2478] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:28.191783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.202920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df85af-2284-4a56-818d-2e3f9c1a6d87 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.207743 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.208669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.208974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.209256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] PATH_INFO: `/v3/projects/aee5b78c7c7e4563a4c626e9c03f8b1d/users/900f690a25f74308bfdb3ed915c2ce2d/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.211258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee5b78c7c7e4563a4c626e9c03f8b1d, user_id=900f690a25f74308bfdb3ed915c2ce2d, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.213940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.221608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:28.227186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1248/2479] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:28 2022] PUT /identity/v3/projects/aee5b78c7c7e4563a4c626e9c03f8b1d/users/900f690a25f74308bfdb3ed915c2ce2d/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:28.238228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1322bd-6b54-4774-8999-4b06896ff6b0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.238516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1322bd-6b54-4774-8999-4b06896ff6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.238846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1322bd-6b54-4774-8999-4b06896ff6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.268882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5d1322bd-6b54-4774-8999-4b06896ff6b0 None None] MFA Rules not processed for user `900f690a25f74308bfdb3ed915c2ce2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:28.270115 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d1322bd-6b54-4774-8999-4b06896ff6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:28.347328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1232/2480] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:28.361360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.363094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:28.424348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdc1a-b06b-459f-9635-7f2b0168d57c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.428107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6890cf-7c6a-4970-a839-cc6a6b065145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.428778 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6890cf-7c6a-4970-a839-cc6a6b065145 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.429067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6890cf-7c6a-4970-a839-cc6a6b065145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.429344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6890cf-7c6a-4970-a839-cc6a6b065145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.439563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6890cf-7c6a-4970-a839-cc6a6b065145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.441047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6890cf-7c6a-4970-a839-cc6a6b065145 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.451362 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1249/2481] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:28.881009 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1322bd-6b54-4774-8999-4b06896ff6b0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.909557 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:28.948738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1322bd-6b54-4774-8999-4b06896ff6b0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.954416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.955321 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.955602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.955875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] PATH_INFO: `/v3/users/5265006421e54e8f87674a88421416ba` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.957118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5265006421e54e8f87674a88421416ba)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.959067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.010358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5265006421e54e8f87674a88421416ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.020900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5265006421e54e8f87674a88421416ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.020900 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5265006421e54e8f87674a88421416ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.021419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5265006421e54e8f87674a88421416ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.039078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5265006421e54e8f87674a88421416ba'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.052188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1233/2482] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:28 2022] DELETE /identity/v3/users/5265006421e54e8f87674a88421416ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:29.056991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.057494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.057605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.077590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:29.078864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:29.145384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1250/2483] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:29.156119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.157569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:29.223688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd832981-226b-4d1f-bdf3-6d4f3d76df73 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.228464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.229131 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.229413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.229688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.240982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.242447 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.253849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1234/2484] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:29.543923 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.546351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:29.560503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec316d4-a3a9-48d2-b3c5-d2690ce6e51d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.565938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.566819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.567102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.567383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] PATH_INFO: `/v3/projects/91e0fa6bc6b949f6b433f4b9fa7d0047` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.568626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e0fa6bc6b949f6b433f4b9fa7d0047)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.570589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.630305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e0fa6bc6b949f6b433f4b9fa7d0047', 'request_id': 'req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.636860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e0fa6bc6b949f6b433f4b9fa7d0047', 'request_id': 'req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.651023 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e0fa6bc6b949f6b433f4b9fa7d0047', 'request_id': 'req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.663404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] The token cache is being invalidate because project 91e0fa6bc6b949f6b433f4b9fa7d0047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:29.663696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.664417 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.666047 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1251/2485] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:29 2022] DELETE /identity/v3/projects/91e0fa6bc6b949f6b433f4b9fa7d0047 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:29.671046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.681012 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b17f-ac8f-4a49-ba4e-85908aa7a55c service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.737770 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:29.753585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.754478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.754764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.755042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] PATH_INFO: `/v3/users/900f690a25f74308bfdb3ed915c2ce2d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.756330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900f690a25f74308bfdb3ed915c2ce2d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.758311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.815745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900f690a25f74308bfdb3ed915c2ce2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.822655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900f690a25f74308bfdb3ed915c2ce2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.823344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900f690a25f74308bfdb3ed915c2ce2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.823950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900f690a25f74308bfdb3ed915c2ce2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.836970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5f4b2dd1-baa0-4a7d-890a-b5f4f20743b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900f690a25f74308bfdb3ed915c2ce2d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:29.850301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1235/2486] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:29 2022] DELETE /identity/v3/users/900f690a25f74308bfdb3ed915c2ce2d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:30.149326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.150824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:30.165916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7478-5b00-4f69-8bb0-742a5fa4ca23 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.195686 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.247011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.248452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.248738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.249025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] PATH_INFO: `/v3/projects/aee5b78c7c7e4563a4c626e9c03f8b1d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.250465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee5b78c7c7e4563a4c626e9c03f8b1d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.252424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.307615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee5b78c7c7e4563a4c626e9c03f8b1d', 'request_id': 'req-89120292-27b0-439a-80d6-9868dec2545f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:30.315262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee5b78c7c7e4563a4c626e9c03f8b1d', 'request_id': 'req-89120292-27b0-439a-80d6-9868dec2545f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:30.324617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee5b78c7c7e4563a4c626e9c03f8b1d', 'request_id': 'req-89120292-27b0-439a-80d6-9868dec2545f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:30.336885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] The token cache is being invalidate because project aee5b78c7c7e4563a4c626e9c03f8b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:30.337174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:30.337845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-89120292-27b0-439a-80d6-9868dec2545f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:30.339497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1252/2487] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:30 2022] DELETE /identity/v3/projects/aee5b78c7c7e4563a4c626e9c03f8b1d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:08:30.345877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92974d1-95d8-40a4-9141-489d27195c0b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.346444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92974d1-95d8-40a4-9141-489d27195c0b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.346444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92974d1-95d8-40a4-9141-489d27195c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.367285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d92974d1-95d8-40a4-9141-489d27195c0b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:30.368560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d92974d1-95d8-40a4-9141-489d27195c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:30.434779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1236/2488] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:30.443016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017f61-7818-4f87-b0c8-2e59118263a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.443313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017f61-7818-4f87-b0c8-2e59118263a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.443600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017f61-7818-4f87-b0c8-2e59118263a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.466438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-09017f61-7818-4f87-b0c8-2e59118263a9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:30.469130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-09017f61-7818-4f87-b0c8-2e59118263a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:30.477440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1253/2489] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:30.483052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92974d1-95d8-40a4-9141-489d27195c0b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.493392 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92974d1-95d8-40a4-9141-489d27195c0b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.498398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.499068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.499355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.499638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.500438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:30.500806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.502414 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.516759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1237/2490] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:30.523029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09017f61-7818-4f87-b0c8-2e59118263a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.535721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09017f61-7818-4f87-b0c8-2e59118263a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.542605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.543607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.544109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.544572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.546449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.549292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.600526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1254/2491] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:30.602393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.615817 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c101fb1-ee8d-400f-9c3c-f3d8fc0890f7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.683346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.697352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.698096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.698423 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.698930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.699743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.703062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.736257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1238/2492] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:30.743132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.765513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058754d-fd19-4e7d-a4e5-956b02b3e6ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.773861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.774915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.775355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.775773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.777127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.779985 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.803849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1255/2493] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:08:30.805760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.823181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430e7d-b447-4f12-b083-fa92dede64d4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.829444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507b65c-9efd-4195-a82a-ddc4fc7e31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.830177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b65c-9efd-4195-a82a-ddc4fc7e31e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.830492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b65c-9efd-4195-a82a-ddc4fc7e31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.830811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b65c-9efd-4195-a82a-ddc4fc7e31e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.831602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507b65c-9efd-4195-a82a-ddc4fc7e31e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.833569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507b65c-9efd-4195-a82a-ddc4fc7e31e8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.845866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1239/2494] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:30.850680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.863150 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dd482-8cbe-4454-bef8-7a4fbd039923 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.868455 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.869375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.869667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.869949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] PATH_INFO: `/v3/projects/bf5feee1730e48eab5036029054bcdeb/users/92a9c912782b4f45a3e024a6c54a369c/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.888906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5feee1730e48eab5036029054bcdeb, user_id=92a9c912782b4f45a3e024a6c54a369c, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.891826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.908097 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1256/2495] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:30 2022] PUT /identity/v3/projects/bf5feee1730e48eab5036029054bcdeb/users/92a9c912782b4f45a3e024a6c54a369c/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:30.918866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb471-6b21-453f-81a2-566d51865018 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.919768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb471-6b21-453f-81a2-566d51865018 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.919768 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb471-6b21-453f-81a2-566d51865018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.951139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cbffb471-6b21-453f-81a2-566d51865018 None None] MFA Rules not processed for user `92a9c912782b4f45a3e024a6c54a369c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:30.952415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cbffb471-6b21-453f-81a2-566d51865018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:31.034291 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1240/2496] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:31.038898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.106581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.120120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c676273-0206-4bfb-a6a6-80049511a633 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.128157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.128884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.129177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.129461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.130182 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.132225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.160477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1257/2497] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:31 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:31.164734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffb471-6b21-453f-81a2-566d51865018 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.177252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffb471-6b21-453f-81a2-566d51865018 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.238308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.239005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.239289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.239566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.240295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.242247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.263715 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1241/2498] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:31 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:31.268109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.280378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114214-f19c-46ec-aa8e-b29df9ee7aee admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.286860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.287584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.287889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.288227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.289074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.290863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.304294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1258/2499] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:08:31.308872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.325688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84966f2-3b66-4427-8f1d-34affc177d2e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.331183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.332165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.332450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.332737 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] PATH_INFO: `/v3/projects/63b60b96dca54a119e0a3eb7d13f2e7a/users/76d3d8dd9a394719b496aa6b99169560/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.349863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b60b96dca54a119e0a3eb7d13f2e7a, user_id=76d3d8dd9a394719b496aa6b99169560, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.353993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.369298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1242/2500] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:31 2022] PUT /identity/v3/projects/63b60b96dca54a119e0a3eb7d13f2e7a/users/76d3d8dd9a394719b496aa6b99169560/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:31.374048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.385495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90307515-84bc-4c89-a62e-583d4655939d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.451588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5fd43-2d62-48f6-9d3d-a4f12873c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.452315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5fd43-2d62-48f6-9d3d-a4f12873c699 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.452604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5fd43-2d62-48f6-9d3d-a4f12873c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.452884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5fd43-2d62-48f6-9d3d-a4f12873c699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.453631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5fd43-2d62-48f6-9d3d-a4f12873c699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.455253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5fd43-2d62-48f6-9d3d-a4f12873c699 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.466186 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1259/2501] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:31.471468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.491997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49af3c-f24c-4d59-98f4-a5efdc9b4cf8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.498098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.499589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.499887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.500198 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] PATH_INFO: `/v3/projects/63b60b96dca54a119e0a3eb7d13f2e7a/users/76d3d8dd9a394719b496aa6b99169560/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.502309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b60b96dca54a119e0a3eb7d13f2e7a, user_id=76d3d8dd9a394719b496aa6b99169560, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.505041 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.517090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1243/2502] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:31 2022] PUT /identity/v3/projects/63b60b96dca54a119e0a3eb7d13f2e7a/users/76d3d8dd9a394719b496aa6b99169560/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:31.529004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.529321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.529590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.559128 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] MFA Rules not processed for user `76d3d8dd9a394719b496aa6b99169560`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:31.560317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:31.639517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1260/2503] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:31.651758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.653833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:31.669378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.715922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fd75b-5670-4c96-b0c8-61d0e675eb3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.720061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.720730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.721197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.721486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.731428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.733419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.744226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1244/2504] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:31.799221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.800684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:31.813386 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91bc65-6777-4189-9b31-f7bb7a79743b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.817042 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97940981-a48f-40cd-8ea7-e4440b32e9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.817702 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940981-a48f-40cd-8ea7-e4440b32e9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.817990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940981-a48f-40cd-8ea7-e4440b32e9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.818292 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940981-a48f-40cd-8ea7-e4440b32e9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.867508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.882153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97940981-a48f-40cd-8ea7-e4440b32e9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.883725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97940981-a48f-40cd-8ea7-e4440b32e9d9 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.893770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1261/2505] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:35.305635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.375566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e097-c2b4-4fc8-a9aa-b8b18b8b099a service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.381111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.382247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.382516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.382852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] PATH_INFO: `/v3/users/92a9c912782b4f45a3e024a6c54a369c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.384329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a9c912782b4f45a3e024a6c54a369c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.386363 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.439130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a9c912782b4f45a3e024a6c54a369c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:35.446753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a9c912782b4f45a3e024a6c54a369c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:35.447626 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a9c912782b4f45a3e024a6c54a369c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:35.448400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a9c912782b4f45a3e024a6c54a369c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:35.464685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a9c912782b4f45a3e024a6c54a369c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:35.480318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1245/2506] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:35 2022] DELETE /identity/v3/users/92a9c912782b4f45a3e024a6c54a369c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:35.485670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.486215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.486215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.506749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:35.508132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:35.574854 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1262/2507] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:35.585973 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.587448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:35.629867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.649627 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1796c33-ce3a-4dbe-a290-a9d15847812b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.653978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.654638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.654938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.655197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.667271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.670376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.691099 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1246/2508] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:35.985725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.987329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:36.006445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a3311-940a-4ccb-9f6f-8fd011e9b4b7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.011551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.012346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.012633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.012912 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] PATH_INFO: `/v3/projects/bf5feee1730e48eab5036029054bcdeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.014098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5feee1730e48eab5036029054bcdeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.016160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.070437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5feee1730e48eab5036029054bcdeb', 'request_id': 'req-c1bdc604-293e-4786-a3a9-9be5111a1ee3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.078378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5feee1730e48eab5036029054bcdeb', 'request_id': 'req-c1bdc604-293e-4786-a3a9-9be5111a1ee3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.090153 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5feee1730e48eab5036029054bcdeb', 'request_id': 'req-c1bdc604-293e-4786-a3a9-9be5111a1ee3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.106678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] The token cache is being invalidate because project bf5feee1730e48eab5036029054bcdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:36.107069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.108044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.110898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1263/2509] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:35 2022] DELETE /identity/v3/projects/bf5feee1730e48eab5036029054bcdeb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:36.115064 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.126865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a621cc-c182-4249-8e6c-c0b1a406a027 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.197223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.198105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.198389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.198661 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] PATH_INFO: `/v3/users/76d3d8dd9a394719b496aa6b99169560` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.199864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d3d8dd9a394719b496aa6b99169560)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.201843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.268771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d3d8dd9a394719b496aa6b99169560'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.276893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d3d8dd9a394719b496aa6b99169560'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.277565 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d3d8dd9a394719b496aa6b99169560'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.278227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d3d8dd9a394719b496aa6b99169560'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.299077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cdf9b0ca-46c6-435f-8b02-537342f529d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d3d8dd9a394719b496aa6b99169560'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.318718 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1247/2510] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:36 2022] DELETE /identity/v3/users/76d3d8dd9a394719b496aa6b99169560 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:36.643024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.645008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:36.662539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdc604-293e-4786-a3a9-9be5111a1ee3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.739046 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.740675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.741428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.741930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] PATH_INFO: `/v3/projects/63b60b96dca54a119e0a3eb7d13f2e7a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.743565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b60b96dca54a119e0a3eb7d13f2e7a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.745557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.759125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.806999 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b60b96dca54a119e0a3eb7d13f2e7a', 'request_id': 'req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.813847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b60b96dca54a119e0a3eb7d13f2e7a', 'request_id': 'req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.822471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b60b96dca54a119e0a3eb7d13f2e7a', 'request_id': 'req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.835124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] The token cache is being invalidate because project 63b60b96dca54a119e0a3eb7d13f2e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:36.835420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.836160 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-10da3658-747b-4f3a-9fcc-9f3cd1bd6afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:36.837718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1264/2511] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:36 2022] DELETE /identity/v3/projects/63b60b96dca54a119e0a3eb7d13f2e7a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:36.842714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6355e-d905-463a-9624-dd13204f411f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.843639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6355e-d905-463a-9624-dd13204f411f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.844172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6355e-d905-463a-9624-dd13204f411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.864785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-10b6355e-d905-463a-9624-dd13204f411f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:36.866038 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-10b6355e-d905-463a-9624-dd13204f411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:36.922200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.933315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1248/2512] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:36.941760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae22b5-775a-4b2e-ac0c-0f98d4915c9c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.942049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae22b5-775a-4b2e-ac0c-0f98d4915c9c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.942331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae22b5-775a-4b2e-ac0c-0f98d4915c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.961437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-35ae22b5-775a-4b2e-ac0c-0f98d4915c9c None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:36.962665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-35ae22b5-775a-4b2e-ac0c-0f98d4915c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:36.973249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1265/2513] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:36.978197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6355e-d905-463a-9624-dd13204f411f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.991734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6355e-d905-463a-9624-dd13204f411f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.996525 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.997191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.997510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.997795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.998532 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:36.998848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.001011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.012942 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1249/2514] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:37.018395 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae22b5-775a-4b2e-ac0c-0f98d4915c9c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.027820 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae22b5-775a-4b2e-ac0c-0f98d4915c9c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.032564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.033222 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.033511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.033798 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.034500 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.036441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.063783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1266/2515] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:37.072870 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.080072 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1366ee-6047-43ca-b31d-34540f83e1bb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.141680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.142361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.142649 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.142932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.143636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.145624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.166573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1250/2516] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:37.170840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.182255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941a910-044d-4103-9d2e-cb7fd6429b84 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.187650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.188555 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.188814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.189092 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.189828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.191421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.204930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1267/2517] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:37.209045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.220732 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d18ae-01de-4638-ac56-78681f2901a5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.226239 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26873c-67e2-4c8e-beed-a8094daa2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.227261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26873c-67e2-4c8e-beed-a8094daa2820 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.227548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26873c-67e2-4c8e-beed-a8094daa2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.227831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26873c-67e2-4c8e-beed-a8094daa2820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.228643 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26873c-67e2-4c8e-beed-a8094daa2820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.230272 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26873c-67e2-4c8e-beed-a8094daa2820 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.242132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1251/2518] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:37.248244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.259804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18943553-0c38-4bcc-9261-9b7dff7b324b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.264656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.266165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.266449 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.266761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] PATH_INFO: `/v3/projects/35b4733958594ccb9b63a84a03c2bc5c/users/11667be0212a4352ad5930ae7a0c7856/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.282374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b4733958594ccb9b63a84a03c2bc5c, user_id=11667be0212a4352ad5930ae7a0c7856, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.285138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.299608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1268/2519] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:37 2022] PUT /identity/v3/projects/35b4733958594ccb9b63a84a03c2bc5c/users/11667be0212a4352ad5930ae7a0c7856/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:37.310100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6b40-5aa0-40e9-8100-8da9e838c829 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.310418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6b40-5aa0-40e9-8100-8da9e838c829 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.310698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6b40-5aa0-40e9-8100-8da9e838c829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.339290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-775b6b40-5aa0-40e9-8100-8da9e838c829 None None] MFA Rules not processed for user `11667be0212a4352ad5930ae7a0c7856`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:37.340550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-775b6b40-5aa0-40e9-8100-8da9e838c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:37.419350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1252/2520] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:37.427373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.492514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca07c82-ae2d-427f-b30a-09cd365b9f47 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.503352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.504068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.504361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.504631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.505331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.507323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.535493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1269/2521] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:37.539668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6b40-5aa0-40e9-8100-8da9e838c829 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.552153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6b40-5aa0-40e9-8100-8da9e838c829 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.613493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.625154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.625838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.626126 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.626405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.627105 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.629088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.648918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1253/2522] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:37.653202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.665589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0663b-0a96-4479-b02e-09f8afafd352 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.670564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.671878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.672205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.672493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.673254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.674881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.688930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1270/2523] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:37.693117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.703331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9478a7-8c03-4b9c-92ea-48355e98b8bd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.708735 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4ccd-74e2-4ff0-9ee4-78a3689b87c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.709835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4ccd-74e2-4ff0-9ee4-78a3689b87c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.710343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4ccd-74e2-4ff0-9ee4-78a3689b87c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.710881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4ccd-74e2-4ff0-9ee4-78a3689b87c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.712385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4ccd-74e2-4ff0-9ee4-78a3689b87c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.715631 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4ccd-74e2-4ff0-9ee4-78a3689b87c7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.733162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1254/2524] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:37.738400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.751732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e050a71-1bb7-4182-b679-07ef98fd1503 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.758026 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.759261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.760663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.760663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] PATH_INFO: `/v3/projects/6fa8c36892ee411bafa65474a8fa8bdd/users/a7912d4c3db34e72b93d91ad1b9652b4/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.772179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.785239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa8c36892ee411bafa65474a8fa8bdd, user_id=a7912d4c3db34e72b93d91ad1b9652b4, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.789545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.811079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1271/2525] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:37 2022] PUT /identity/v3/projects/6fa8c36892ee411bafa65474a8fa8bdd/users/a7912d4c3db34e72b93d91ad1b9652b4/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:37.831716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87cd8a-98ca-4fa4-9ebe-a0344c0263b1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.832288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87cd8a-98ca-4fa4-9ebe-a0344c0263b1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.833337 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87cd8a-98ca-4fa4-9ebe-a0344c0263b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.867343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9e87cd8a-98ca-4fa4-9ebe-a0344c0263b1 None None] MFA Rules not processed for user `a7912d4c3db34e72b93d91ad1b9652b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:37.868701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9e87cd8a-98ca-4fa4-9ebe-a0344c0263b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:37.964034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1255/2526] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:37.977906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.074792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b202f6e-d13b-4c79-957b-f9101531ef20 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.081456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.082149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.082431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.082710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.083436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.085469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.118291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1272/2527] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:38.124604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87cd8a-98ca-4fa4-9ebe-a0344c0263b1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.141601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87cd8a-98ca-4fa4-9ebe-a0344c0263b1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.250110 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.251688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.252915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.252915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.253881 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.257413 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.286852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1256/2528] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:38 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:38.291113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.306871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccedb84-38be-42d1-8fbe-0efa277dd856 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.316584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.318185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.318862 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.319296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.320776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.324370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.337990 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1273/2529] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:38.342222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.355506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd273c-a60e-4d1e-a65a-eab5a89a0af0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.361874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.362940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.363371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.363593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] PATH_INFO: `/v3/projects/5019d62b9ab84781acd3d6eba231212c/users/7875ba85938942cc8e026cd89224a557/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.382215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5019d62b9ab84781acd3d6eba231212c, user_id=7875ba85938942cc8e026cd89224a557, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.385026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.405634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1257/2530] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:38 2022] PUT /identity/v3/projects/5019d62b9ab84781acd3d6eba231212c/users/7875ba85938942cc8e026cd89224a557/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:38.411264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.423568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce693b6-eeae-4d7c-88fe-8ad71f28de65 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.511068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417561b0-2cda-4a07-a2d3-9d7c74ccbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.511748 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417561b0-2cda-4a07-a2d3-9d7c74ccbe58 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.512068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417561b0-2cda-4a07-a2d3-9d7c74ccbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.512358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417561b0-2cda-4a07-a2d3-9d7c74ccbe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.513144 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417561b0-2cda-4a07-a2d3-9d7c74ccbe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.515091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417561b0-2cda-4a07-a2d3-9d7c74ccbe58 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.526863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1274/2531] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:38.531725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.543015 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaff91-0137-4e06-8cb3-02dcbea0818d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.550442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.552115 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.552663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.553328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] PATH_INFO: `/v3/projects/5019d62b9ab84781acd3d6eba231212c/users/7875ba85938942cc8e026cd89224a557/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.556570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5019d62b9ab84781acd3d6eba231212c, user_id=7875ba85938942cc8e026cd89224a557, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.559319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.576343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1258/2532] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:38 2022] PUT /identity/v3/projects/5019d62b9ab84781acd3d6eba231212c/users/7875ba85938942cc8e026cd89224a557/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:38.597299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbf01-c518-4cd4-9eb3-e987ef773aaa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.597876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbf01-c518-4cd4-9eb3-e987ef773aaa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.598510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bbf01-c518-4cd4-9eb3-e987ef773aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.652780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-909bbf01-c518-4cd4-9eb3-e987ef773aaa None None] MFA Rules not processed for user `7875ba85938942cc8e026cd89224a557`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:38.654913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-909bbf01-c518-4cd4-9eb3-e987ef773aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:38.733848 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.783029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1275/2533] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:38.805380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.807247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:38.842208 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.935013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56f597-7042-4a9c-868a-a30aa524e99a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.939516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66789c-7ae6-43da-acc6-fbad1973ae37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.940218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66789c-7ae6-43da-acc6-fbad1973ae37 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.940504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66789c-7ae6-43da-acc6-fbad1973ae37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.940783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66789c-7ae6-43da-acc6-fbad1973ae37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.959840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66789c-7ae6-43da-acc6-fbad1973ae37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.961340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66789c-7ae6-43da-acc6-fbad1973ae37 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.973591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1259/2534] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:39.082481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bbf01-c518-4cd4-9eb3-e987ef773aaa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.099714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bbf01-c518-4cd4-9eb3-e987ef773aaa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.106287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.106993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.107441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.107769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.206763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.208364 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.221044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1276/2535] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:40.138084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728771c-fd30-4625-aa40-7b78f663c9d0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:40.139206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728771c-fd30-4625-aa40-7b78f663c9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:40.139668 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728771c-fd30-4625-aa40-7b78f663c9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:40.162137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2728771c-fd30-4625-aa40-7b78f663c9d0 None None] MFA Rules not processed for user `9683ec43ae844757883a7dd5003b53d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:40.164662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2728771c-fd30-4625-aa40-7b78f663c9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:40.262512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1260/2536] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:42.476327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.626477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c339c54-ed87-41a1-a70d-2ae79fb97d54 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.634142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.635082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.635361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.635669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] PATH_INFO: `/v3/users/11667be0212a4352ad5930ae7a0c7856` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.637513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11667be0212a4352ad5930ae7a0c7856)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.639517 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.701404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11667be0212a4352ad5930ae7a0c7856'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:42.733662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11667be0212a4352ad5930ae7a0c7856'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:42.749387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11667be0212a4352ad5930ae7a0c7856'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:42.764469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11667be0212a4352ad5930ae7a0c7856'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:42.766261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11667be0212a4352ad5930ae7a0c7856'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:42.769388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.775807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1277/2537] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:42 2022] DELETE /identity/v3/users/11667be0212a4352ad5930ae7a0c7856 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:08:42.780503 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.781139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.781139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.812695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:42.815286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:42.909432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1261/2538] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:42.920057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.921612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:43.027065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90657b9-854d-4b2e-9b10-ca9300012a91 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.032520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.033563 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.033688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.033871 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.046805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.049337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.062174 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1278/2539] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:43.620344 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.621860 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:43.635492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d307fe-44bd-435a-b770-d5d75102c342 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.643080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.643730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.644042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.645233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] PATH_INFO: `/v3/projects/35b4733958594ccb9b63a84a03c2bc5c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.647005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b4733958594ccb9b63a84a03c2bc5c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.649382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.723965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b4733958594ccb9b63a84a03c2bc5c', 'request_id': 'req-04dd82c7-409f-4a56-ac84-3d24110b7b18'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.733080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b4733958594ccb9b63a84a03c2bc5c', 'request_id': 'req-04dd82c7-409f-4a56-ac84-3d24110b7b18'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.734707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.741339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b4733958594ccb9b63a84a03c2bc5c', 'request_id': 'req-04dd82c7-409f-4a56-ac84-3d24110b7b18'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.755648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] The token cache is being invalidate because project 35b4733958594ccb9b63a84a03c2bc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:43.756416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.757231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.759449 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1262/2540] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:43 2022] DELETE /identity/v3/projects/35b4733958594ccb9b63a84a03c2bc5c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:43.769938 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.789243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b57e6-be08-4b2a-be23-738f9e9034d1 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.858578 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.859377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.860719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.863615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] PATH_INFO: `/v3/users/a7912d4c3db34e72b93d91ad1b9652b4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.865180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7912d4c3db34e72b93d91ad1b9652b4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.867137 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.918347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7912d4c3db34e72b93d91ad1b9652b4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.932037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7912d4c3db34e72b93d91ad1b9652b4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.940164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7912d4c3db34e72b93d91ad1b9652b4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.947827 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7912d4c3db34e72b93d91ad1b9652b4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.948580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7912d4c3db34e72b93d91ad1b9652b4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:43.955029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1279/2541] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:43 2022] DELETE /identity/v3/users/a7912d4c3db34e72b93d91ad1b9652b4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:44.247112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:44.248701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:44.262187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd82c7-409f-4a56-ac84-3d24110b7b18 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:44.336422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:44.337889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:44.338317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:44.338825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] PATH_INFO: `/v3/projects/6fa8c36892ee411bafa65474a8fa8bdd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:44.341016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa8c36892ee411bafa65474a8fa8bdd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:44.345599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:44.398998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa8c36892ee411bafa65474a8fa8bdd', 'request_id': 'req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.406391 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa8c36892ee411bafa65474a8fa8bdd', 'request_id': 'req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.413046 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa8c36892ee411bafa65474a8fa8bdd', 'request_id': 'req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.424870 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] The token cache is being invalidate because project 6fa8c36892ee411bafa65474a8fa8bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:44.425167 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.425961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.427614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1263/2542] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:44 2022] DELETE /identity/v3/projects/6fa8c36892ee411bafa65474a8fa8bdd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:44.431880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:44.433556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:44.449056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71dda0-694c-4c2c-81e4-323016308d53 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:44.468456 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:44.512307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:44.513202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:44.513493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:44.513780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] PATH_INFO: `/v3/users/7875ba85938942cc8e026cd89224a557` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:44.515059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7875ba85938942cc8e026cd89224a557)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:44.517941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:44.570948 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7875ba85938942cc8e026cd89224a557'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.584897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7875ba85938942cc8e026cd89224a557'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.602613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7875ba85938942cc8e026cd89224a557'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.610941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7875ba85938942cc8e026cd89224a557'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.611925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62f30d28-3fa7-4911-b519-6af9da988e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7875ba85938942cc8e026cd89224a557'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:44.618328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1280/2543] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:44 2022] DELETE /identity/v3/users/7875ba85938942cc8e026cd89224a557 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:08:45.152748 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.154245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:45.168109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd7e0-a0bd-4e7a-a4bd-1ed4da02f66d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.232632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.233502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.233785 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.234063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] PATH_INFO: `/v3/projects/5019d62b9ab84781acd3d6eba231212c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.235807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5019d62b9ab84781acd3d6eba231212c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.237957 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.257312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:45.300851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5019d62b9ab84781acd3d6eba231212c', 'request_id': 'req-4fd5b6c1-557f-4149-88c7-83001edbe861'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:45.310340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5019d62b9ab84781acd3d6eba231212c', 'request_id': 'req-4fd5b6c1-557f-4149-88c7-83001edbe861'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:45.317123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5019d62b9ab84781acd3d6eba231212c', 'request_id': 'req-4fd5b6c1-557f-4149-88c7-83001edbe861'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:45.329219 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] The token cache is being invalidate because project 5019d62b9ab84781acd3d6eba231212c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:45.329767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:45.330485 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4fd5b6c1-557f-4149-88c7-83001edbe861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:45.332401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1264/2544] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:45 2022] DELETE /identity/v3/projects/5019d62b9ab84781acd3d6eba231212c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:45.338130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ce703-0057-4432-9653-a2bf88b2c424 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.338752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ce703-0057-4432-9653-a2bf88b2c424 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.338752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ce703-0057-4432-9653-a2bf88b2c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.358841 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8c8ce703-0057-4432-9653-a2bf88b2c424 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:45.360711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8c8ce703-0057-4432-9653-a2bf88b2c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:45.440879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1281/2545] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:45.442884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957f43-bc3d-494b-aaa9-c7a70ffe405f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.443230 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957f43-bc3d-494b-aaa9-c7a70ffe405f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.443514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957f43-bc3d-494b-aaa9-c7a70ffe405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.463396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a2957f43-bc3d-494b-aaa9-c7a70ffe405f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:45.464653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a2957f43-bc3d-494b-aaa9-c7a70ffe405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:45.473938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1265/2546] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:45.478782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ce703-0057-4432-9653-a2bf88b2c424 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.490181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ce703-0057-4432-9653-a2bf88b2c424 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.495285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.495979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.496348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.496585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.497336 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:45.497665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.499788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.512816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1282/2547] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:45.518218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957f43-bc3d-494b-aaa9-c7a70ffe405f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.527979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957f43-bc3d-494b-aaa9-c7a70ffe405f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.533460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.534128 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.534412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.534691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.535404 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.537358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.564602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1266/2548] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:45.568941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.579551 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e22bd3-03ef-43c8-938c-b3ce4382fd57 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.621072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:45.680968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.681666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.681953 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.682230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.683024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.685070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.715874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1283/2549] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:45.717415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.729044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099495f-0e26-41d0-8d15-111023c6cfdc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.734788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.736674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.736674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.737025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.738051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.739473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.764685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.765999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1267/2550] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:08:45.777930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113cf5a-875a-485d-ac0c-940e3896a403 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.783587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bb492-0315-40d8-87ee-4d2f9c005db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.784582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bb492-0315-40d8-87ee-4d2f9c005db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.784939 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bb492-0315-40d8-87ee-4d2f9c005db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.785294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bb492-0315-40d8-87ee-4d2f9c005db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.786138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bb492-0315-40d8-87ee-4d2f9c005db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.787835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bb492-0315-40d8-87ee-4d2f9c005db2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.804489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1284/2551] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:08:45.805455 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.822419 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3a221-fdd6-4a72-85b7-00bb7f170e5d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.830243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.830846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.831132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.831692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] PATH_INFO: `/v3/projects/f6805a7efbeb448d8bc42a86ff756071/users/6ab7e96c0db34764bc2ac1e20d0ac35e/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.850786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6805a7efbeb448d8bc42a86ff756071, user_id=6ab7e96c0db34764bc2ac1e20d0ac35e, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.853684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.870936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1268/2552] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:45 2022] PUT /identity/v3/projects/f6805a7efbeb448d8bc42a86ff756071/users/6ab7e96c0db34764bc2ac1e20d0ac35e/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:45.877147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a304e-3056-4113-816a-ae7d24925c51 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.877634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a304e-3056-4113-816a-ae7d24925c51 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.877836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a304e-3056-4113-816a-ae7d24925c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.901014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-683a304e-3056-4113-816a-ae7d24925c51 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:45.902693 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-683a304e-3056-4113-816a-ae7d24925c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:46.000136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1285/2553] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:46.035642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.037762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:46.166558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f989-29c6-4f3d-a522-b304f0a6c181 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:46.171709 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:46.172401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.172786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.173218 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.184685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:46.186301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:46.199375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1269/2554] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:47.948377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66905-ec6a-43ce-95eb-90bda27d222f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.948900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66905-ec6a-43ce-95eb-90bda27d222f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.948900 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66905-ec6a-43ce-95eb-90bda27d222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.980037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-47c66905-ec6a-43ce-95eb-90bda27d222f None None] MFA Rules not processed for user `6ab7e96c0db34764bc2ac1e20d0ac35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:47.981308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-47c66905-ec6a-43ce-95eb-90bda27d222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:48.090704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1286/2555] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:48.103474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.107097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:48.171003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:48.201164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a8803-8cb4-4bd9-b390-68ff650de286 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.208932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.209788 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.210243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.210632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.228830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.236133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.257845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1270/2556] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:49.717962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.718498 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.718665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.738206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] MFA Rules not processed for user `6ab7e96c0db34764bc2ac1e20d0ac35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:49.739431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:49.746461 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1287/2557] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:52.810907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.813330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:52.826656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaaa45-03aa-430b-bd7a-a7cbedc7cfad service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.831138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.831873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.832253 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.832598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.834524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:52.847150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.849044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.859939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1271/2558] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:56.124571 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.129755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:56.204205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.204205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:56.218055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.224388 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b197909-228b-4619-b307-8a5c897c8694 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.232648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.240372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.241203 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.241727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] PATH_INFO: `/v3/users/2691e1dc96e942b5ba4c726b72a835e9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.251377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2691e1dc96e942b5ba4c726b72a835e9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.255443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.276212 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39c3cd-2270-419c-a883-619331d99d90 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.292829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.293844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.294138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.294568 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.296770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:56.311453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.313124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.325406 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1288/2559] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:56.328719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2691e1dc96e942b5ba4c726b72a835e9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.341231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2691e1dc96e942b5ba4c726b72a835e9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.342249 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2691e1dc96e942b5ba4c726b72a835e9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.343339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2691e1dc96e942b5ba4c726b72a835e9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.359055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-56f37dc4-a95d-4e9a-8989-3e33f0ee3d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2691e1dc96e942b5ba4c726b72a835e9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.374107 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1272/2560] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:08:56 2022] DELETE /identity/v3/users/2691e1dc96e942b5ba4c726b72a835e9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:56.585340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.599001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186a0c0-545c-404b-a758-79fa093de72e service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.670713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.671596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.671886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.672200 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] PATH_INFO: `/v3/projects/8920d2de9dc34386bb0e770f5b51b702` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.674035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8920d2de9dc34386bb0e770f5b51b702)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.676609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.727175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8920d2de9dc34386bb0e770f5b51b702', 'request_id': 'req-14645831-12f2-4c9e-8bd3-8c64cd6f6981'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.733448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8920d2de9dc34386bb0e770f5b51b702', 'request_id': 'req-14645831-12f2-4c9e-8bd3-8c64cd6f6981'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.741950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8920d2de9dc34386bb0e770f5b51b702', 'request_id': 'req-14645831-12f2-4c9e-8bd3-8c64cd6f6981'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.752878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] The token cache is being invalidate because project 8920d2de9dc34386bb0e770f5b51b702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:56.753230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.753897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-14645831-12f2-4c9e-8bd3-8c64cd6f6981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:56.755465 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1289/2561] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:08:56 2022] DELETE /identity/v3/projects/8920d2de9dc34386bb0e770f5b51b702 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:56.760711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a5789-3610-498d-a990-669162945399 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.761016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a5789-3610-498d-a990-669162945399 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.761307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a5789-3610-498d-a990-669162945399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.781934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8d6a5789-3610-498d-a990-669162945399 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:56.783154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8d6a5789-3610-498d-a990-669162945399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:56.852723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1273/2562] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:56.860611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed980c-d6a4-4b29-8a68-06579c9189f1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.860922 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed980c-d6a4-4b29-8a68-06579c9189f1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.861203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed980c-d6a4-4b29-8a68-06579c9189f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.882078 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a9ed980c-d6a4-4b29-8a68-06579c9189f1 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:56.883298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9ed980c-d6a4-4b29-8a68-06579c9189f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:56.891279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1290/2563] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:56.896261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a5789-3610-498d-a990-669162945399 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.906188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a5789-3610-498d-a990-669162945399 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.911933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.912634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.912917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.913192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.913929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:56.914237 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.916036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.928692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1274/2564] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:56.933102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed980c-d6a4-4b29-8a68-06579c9189f1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.942289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed980c-d6a4-4b29-8a68-06579c9189f1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.946945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.947624 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.947908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.948227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.948913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.950801 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.978373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1291/2565] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:56 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:56.982662 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.993481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488926d-40a4-4414-82d1-178116f47d01 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.025573 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.060385 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.061144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.061512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.061757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.062695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.065421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.089940 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1275/2566] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:56 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:57.094943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.107043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fbc70-8a16-4021-8f1c-12387f008601 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.112122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.113142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.113427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.113703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.114442 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.116199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.127547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1292/2567] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:57.131728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.141853 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653427-ca7c-48e7-b34b-e1ccb7096853 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.147552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498846d6-0072-406c-af49-06f20aad5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.148284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498846d6-0072-406c-af49-06f20aad5cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.148576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498846d6-0072-406c-af49-06f20aad5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.148861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498846d6-0072-406c-af49-06f20aad5cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.149597 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498846d6-0072-406c-af49-06f20aad5cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.151212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498846d6-0072-406c-af49-06f20aad5cb1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.163764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1276/2568] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:57.167865 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.178409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18254d62-c744-47be-84b3-8fe3a49bed09 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.183270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.184202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.184489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.184768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] PATH_INFO: `/v3/projects/244bcbf9c54c419eb5cf2d14777fde2b/users/a50840ddd28247cb99691ef583d3ae2c/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.193181 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.202726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244bcbf9c54c419eb5cf2d14777fde2b, user_id=a50840ddd28247cb99691ef583d3ae2c, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.205420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.219804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1293/2569] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:57 2022] PUT /identity/v3/projects/244bcbf9c54c419eb5cf2d14777fde2b/users/a50840ddd28247cb99691ef583d3ae2c/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:57.226087 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b614a0b-fd84-48ce-ad29-399b25e292bd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.226614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b614a0b-fd84-48ce-ad29-399b25e292bd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.226711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b614a0b-fd84-48ce-ad29-399b25e292bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.244511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5b614a0b-fd84-48ce-ad29-399b25e292bd None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:57.245640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5b614a0b-fd84-48ce-ad29-399b25e292bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:57.305081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1277/2570] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:57.314804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.318082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:57.377414 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819725-d9cb-411b-907b-d78259949039 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.381359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.382006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.382288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.382564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.392523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.393995 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.403673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1294/2571] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:58.243130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904d4d-84ea-4ff4-9363-40ec3730b35e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.243810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904d4d-84ea-4ff4-9363-40ec3730b35e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.243810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904d4d-84ea-4ff4-9363-40ec3730b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.274561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3f904d4d-84ea-4ff4-9363-40ec3730b35e None None] MFA Rules not processed for user `a50840ddd28247cb99691ef583d3ae2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:58.275831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f904d4d-84ea-4ff4-9363-40ec3730b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:58.369191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1278/2572] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:58.373812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.385696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42bd0d-c1e4-497d-8178-603f93890a08 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.392840 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.393800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.394154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.394489 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.395138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.397347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.431729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1295/2573] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:08:58 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:58.435483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904d4d-84ea-4ff4-9363-40ec3730b35e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.447143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904d4d-84ea-4ff4-9363-40ec3730b35e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.494797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:58.512767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.513451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.513893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.514181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.515233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.517142 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.543822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1279/2574] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:08:58 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:58.545229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.557591 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a0dd2-5862-4877-8219-d6f7d8ffd4df admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.562643 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.563341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.563633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.563942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.564797 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.567043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.582232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1296/2575] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:58.585011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.598206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a29b4-43a6-47b3-b030-6b957f1c91c2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.606169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.607547 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.608273 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.608665 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] PATH_INFO: `/v3/projects/a1c936199bb046358b41fd2ace672712/users/01300d6e8e6642e1ae87f293f5cb9435/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.628182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c936199bb046358b41fd2ace672712, user_id=01300d6e8e6642e1ae87f293f5cb9435, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.630945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.645650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1280/2576] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:58 2022] PUT /identity/v3/projects/a1c936199bb046358b41fd2ace672712/users/01300d6e8e6642e1ae87f293f5cb9435/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:58.649658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.660792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884385ad-1917-4cc5-8e9e-16e5bffd30b3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.732273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632a921-d678-4e9a-82a2-e51438655105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.733271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632a921-d678-4e9a-82a2-e51438655105 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.733587 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632a921-d678-4e9a-82a2-e51438655105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.733887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632a921-d678-4e9a-82a2-e51438655105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.734960 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632a921-d678-4e9a-82a2-e51438655105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.736895 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632a921-d678-4e9a-82a2-e51438655105 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.750761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1297/2577] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:58.757689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.781507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e421b71-af2a-4410-a721-7f8350150442 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.787738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.789082 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.789371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.789652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] PATH_INFO: `/v3/projects/a1c936199bb046358b41fd2ace672712/users/01300d6e8e6642e1ae87f293f5cb9435/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.792381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c936199bb046358b41fd2ace672712, user_id=01300d6e8e6642e1ae87f293f5cb9435, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.795323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.821381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1281/2578] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:08:58 2022] PUT /identity/v3/projects/a1c936199bb046358b41fd2ace672712/users/01300d6e8e6642e1ae87f293f5cb9435/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:59.899615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d97583-4d85-40ce-8478-35188ba2d3f4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.900523 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d97583-4d85-40ce-8478-35188ba2d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.900807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d97583-4d85-40ce-8478-35188ba2d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.934109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c4d97583-4d85-40ce-8478-35188ba2d3f4 None None] MFA Rules not processed for user `01300d6e8e6642e1ae87f293f5cb9435`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:59.935621 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c4d97583-4d85-40ce-8478-35188ba2d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:59.991859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:00.041994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1298/2579] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:08:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:01.541650 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:01.657375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06042cd-e249-40d0-b3a9-73ff60a20b01 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:01.662358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:01.663241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.663531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.663814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] PATH_INFO: `/v3/users/a50840ddd28247cb99691ef583d3ae2c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.665150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50840ddd28247cb99691ef583d3ae2c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:01.667039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:01.729288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50840ddd28247cb99691ef583d3ae2c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:01.741659 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50840ddd28247cb99691ef583d3ae2c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:01.742438 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50840ddd28247cb99691ef583d3ae2c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:01.743141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50840ddd28247cb99691ef583d3ae2c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:01.770267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50840ddd28247cb99691ef583d3ae2c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:01.785955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1282/2580] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:01 2022] DELETE /identity/v3/users/a50840ddd28247cb99691ef583d3ae2c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:02.033007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d97583-4d85-40ce-8478-35188ba2d3f4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.053781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d97583-4d85-40ce-8478-35188ba2d3f4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:02.150096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:02.151171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.151574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.151855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] PATH_INFO: `/v3/projects/244bcbf9c54c419eb5cf2d14777fde2b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.154240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] RBAC: Authorizing `identity:delete_project(project_id=244bcbf9c54c419eb5cf2d14777fde2b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:02.156596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:02.229890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244bcbf9c54c419eb5cf2d14777fde2b', 'request_id': 'req-28aa6902-c4a1-4bfb-8f86-4d273938381a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.239961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244bcbf9c54c419eb5cf2d14777fde2b', 'request_id': 'req-28aa6902-c4a1-4bfb-8f86-4d273938381a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.250232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244bcbf9c54c419eb5cf2d14777fde2b', 'request_id': 'req-28aa6902-c4a1-4bfb-8f86-4d273938381a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.265436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] The token cache is being invalidate because project 244bcbf9c54c419eb5cf2d14777fde2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:02.266358 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.267762 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.270330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1299/2581] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:02 2022] DELETE /identity/v3/projects/244bcbf9c54c419eb5cf2d14777fde2b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:02.274402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.276278 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:02.297522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff571-2ccc-4a9a-aa22-22fd7965093a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:02.311575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:02.420075 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:02.420970 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.421261 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.421544 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] PATH_INFO: `/v3/users/01300d6e8e6642e1ae87f293f5cb9435` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.422795 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01300d6e8e6642e1ae87f293f5cb9435)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:02.424813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:02.493101 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01300d6e8e6642e1ae87f293f5cb9435'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.501553 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01300d6e8e6642e1ae87f293f5cb9435'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.502334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01300d6e8e6642e1ae87f293f5cb9435'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.502966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01300d6e8e6642e1ae87f293f5cb9435'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.532537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7676dc50-11de-4d2a-9bfc-e81e905b3b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01300d6e8e6642e1ae87f293f5cb9435'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:02.556874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1283/2582] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:02 2022] DELETE /identity/v3/users/01300d6e8e6642e1ae87f293f5cb9435 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:02.950949 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.952584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:02.976257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6902-c4a1-4bfb-8f86-4d273938381a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.073337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.074311 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.074603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.074883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] PATH_INFO: `/v3/projects/a1c936199bb046358b41fd2ace672712` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.076303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c936199bb046358b41fd2ace672712)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.078739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.094392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:03.184802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c936199bb046358b41fd2ace672712', 'request_id': 'req-8a61b034-2304-4f14-bcc1-f28e0e51fad0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:03.195297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c936199bb046358b41fd2ace672712', 'request_id': 'req-8a61b034-2304-4f14-bcc1-f28e0e51fad0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:03.206970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c936199bb046358b41fd2ace672712', 'request_id': 'req-8a61b034-2304-4f14-bcc1-f28e0e51fad0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:03.230109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] The token cache is being invalidate because project a1c936199bb046358b41fd2ace672712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:03.230660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:03.232344 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a61b034-2304-4f14-bcc1-f28e0e51fad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:03.234463 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1300/2583] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:02 2022] DELETE /identity/v3/projects/a1c936199bb046358b41fd2ace672712 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:03.240556 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d2353-c109-42b6-b9be-f42675a67624 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.241177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d2353-c109-42b6-b9be-f42675a67624 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.241440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d2353-c109-42b6-b9be-f42675a67624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.263740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c29d2353-c109-42b6-b9be-f42675a67624 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:03.264955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c29d2353-c109-42b6-b9be-f42675a67624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:03.351905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1284/2584] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:03.364079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb0dc-9f98-4088-873a-93105a710e1b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.364079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb0dc-9f98-4088-873a-93105a710e1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.364079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb0dc-9f98-4088-873a-93105a710e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.392240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7b1cb0dc-9f98-4088-873a-93105a710e1b None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:03.393800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b1cb0dc-9f98-4088-873a-93105a710e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:03.416108 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1301/2585] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:09:03.428329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d2353-c109-42b6-b9be-f42675a67624 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.446894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d2353-c109-42b6-b9be-f42675a67624 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.457300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.458604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.459205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.459733 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.460663 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:03.461089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.463013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.478381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1285/2586] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:03.483054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb0dc-9f98-4088-873a-93105a710e1b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.497753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb0dc-9f98-4088-873a-93105a710e1b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.503331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.504793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.505307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.505590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.506335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.508320 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.547981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1302/2587] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:03.548989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.559991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7328ed-7bcf-4c29-acd2-8040d7c9584c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.589324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:03.655471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.656199 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.656484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.656762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.657483 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.659536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.682585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1286/2588] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:03.687305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.699275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0680f7-9c3f-4f6b-81d7-d7a478253a63 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.704222 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.704927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.705216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.705496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.706252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.708408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.720559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1303/2589] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:03.725367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.737055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643cffb-f16b-4cae-a57e-397150a035e0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.744647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a05ae-403b-4f9e-9fbd-dacc87298003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.745478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a05ae-403b-4f9e-9fbd-dacc87298003 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.745775 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a05ae-403b-4f9e-9fbd-dacc87298003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.746060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a05ae-403b-4f9e-9fbd-dacc87298003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.746829 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a05ae-403b-4f9e-9fbd-dacc87298003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.751919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a05ae-403b-4f9e-9fbd-dacc87298003 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.771405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1287/2590] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:03.772864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.784180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dfd55-09e9-4a88-8a18-003d8dcee2e7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.790690 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.791779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.792107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.792396 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] PATH_INFO: `/v3/projects/88b58a8808214295b8ee15083d0f2109/users/c9bff88c59424542871b4a50e7526050/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.810569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b58a8808214295b8ee15083d0f2109, user_id=c9bff88c59424542871b4a50e7526050, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.813428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.829812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1304/2591] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:03 2022] PUT /identity/v3/projects/88b58a8808214295b8ee15083d0f2109/users/c9bff88c59424542871b4a50e7526050/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:03.842958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a2d3d-6d3c-4299-92c3-585442e8cee3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.843260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a2d3d-6d3c-4299-92c3-585442e8cee3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.843538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a2d3d-6d3c-4299-92c3-585442e8cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.875704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1c8a2d3d-6d3c-4299-92c3-585442e8cee3 None None] MFA Rules not processed for user `c9bff88c59424542871b4a50e7526050`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:03.877040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1c8a2d3d-6d3c-4299-92c3-585442e8cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:03.954090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1288/2592] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:03.958936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.029017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510cb26-76c2-4c99-a7d9-f76710c57902 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.033968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.037110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.037110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.037110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.037637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.039268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.071896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1305/2593] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:04.076386 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a2d3d-6d3c-4299-92c3-585442e8cee3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.088319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a2d3d-6d3c-4299-92c3-585442e8cee3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.164405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.165834 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.166200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.166560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.167346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.169640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.200448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1289/2594] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:04 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:09:04.202004 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.213755 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a8965-e4e7-482a-9999-cc3b104e952b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.219897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.220260 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.220542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.220819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.222001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.225323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.240779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1306/2595] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:04.244965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.258091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0033fa-bc2f-47ca-a529-3c2bae7f26f1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.262931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.263827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.264146 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.264437 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] PATH_INFO: `/v3/projects/59a1532982944455a118ba19169e9fa9/users/af988acfc9a246f0be4fcab948af6cd1/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.285926 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a1532982944455a118ba19169e9fa9, user_id=af988acfc9a246f0be4fcab948af6cd1, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.288866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.291585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:04.307568 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1290/2596] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:04 2022] PUT /identity/v3/projects/59a1532982944455a118ba19169e9fa9/users/af988acfc9a246f0be4fcab948af6cd1/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:04.311757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.322764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ec66-7bc4-42ea-8293-58e0895d2618 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.328663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:04.411159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cf718-7c62-4e71-b439-f12b8901d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.412094 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf718-7c62-4e71-b439-f12b8901d52c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.412385 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf718-7c62-4e71-b439-f12b8901d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.412855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf718-7c62-4e71-b439-f12b8901d52c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.413600 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cf718-7c62-4e71-b439-f12b8901d52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.415210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cf718-7c62-4e71-b439-f12b8901d52c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.428240 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1307/2597] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:09:04.432645 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.446535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f23e15-1187-4271-8946-2a597107155f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.452509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.453450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.453685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.453971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] PATH_INFO: `/v3/projects/59a1532982944455a118ba19169e9fa9/users/af988acfc9a246f0be4fcab948af6cd1/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.456468 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a1532982944455a118ba19169e9fa9, user_id=af988acfc9a246f0be4fcab948af6cd1, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.460374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.471751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1291/2598] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:04 2022] PUT /identity/v3/projects/59a1532982944455a118ba19169e9fa9/users/af988acfc9a246f0be4fcab948af6cd1/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:04.483255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44793-5dd9-47cf-9bcb-fe8085f517a8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.483554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44793-5dd9-47cf-9bcb-fe8085f517a8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.483851 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44793-5dd9-47cf-9bcb-fe8085f517a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.511053 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8ec44793-5dd9-47cf-9bcb-fe8085f517a8 None None] MFA Rules not processed for user `af988acfc9a246f0be4fcab948af6cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:04.512329 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8ec44793-5dd9-47cf-9bcb-fe8085f517a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:04.594867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1308/2599] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:04.606523 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.609695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:04.709452 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48b73-8b07-428b-8fca-59c0a995a856 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.717251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.718402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.718917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.719418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.732558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.734327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.747390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1292/2600] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:04.856267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44793-5dd9-47cf-9bcb-fe8085f517a8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.867814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44793-5dd9-47cf-9bcb-fe8085f517a8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.871521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f587-ac94-481b-93f4-8f3a8b5b3cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.872225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f587-ac94-481b-93f4-8f3a8b5b3cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.872504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f587-ac94-481b-93f4-8f3a8b5b3cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.872809 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f587-ac94-481b-93f4-8f3a8b5b3cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.939249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f587-ac94-481b-93f4-8f3a8b5b3cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.940766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f587-ac94-481b-93f4-8f3a8b5b3cd5 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.952184 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1309/2601] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:05.604070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:05.605707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:05.667579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d8bef-806f-4a69-8352-cf158320ad4e service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:05.671916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:05.672979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.673123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.673592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.675537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:05.750883 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:05.752546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:05.764786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1293/2602] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:06.524906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a025a6-9e8f-48e0-8ace-72b3496c1c0f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.526388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a025a6-9e8f-48e0-8ace-72b3496c1c0f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.526734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a025a6-9e8f-48e0-8ace-72b3496c1c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.549781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-93a025a6-9e8f-48e0-8ace-72b3496c1c0f None None] MFA Rules not processed for user `6ab7e96c0db34764bc2ac1e20d0ac35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:06.551100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-93a025a6-9e8f-48e0-8ace-72b3496c1c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:06.579750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:06.617754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1310/2603] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:09.456100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.457638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:09.478098 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342d3eb-d659-4366-89a7-ef8947082f95 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.487504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.488453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.488747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.489607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] PATH_INFO: `/v3/users/a7cc6fcd7b4c4cee8d21e2692757aaf6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.490896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7cc6fcd7b4c4cee8d21e2692757aaf6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.492885 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.525158 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.552922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7cc6fcd7b4c4cee8d21e2692757aaf6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.560993 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7cc6fcd7b4c4cee8d21e2692757aaf6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.561656 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7cc6fcd7b4c4cee8d21e2692757aaf6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.562266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7cc6fcd7b4c4cee8d21e2692757aaf6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.578777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1bfd0a78-6a5c-406f-8890-0ed01207a4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7cc6fcd7b4c4cee8d21e2692757aaf6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.594025 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1294/2604] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:09 2022] DELETE /identity/v3/users/a7cc6fcd7b4c4cee8d21e2692757aaf6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:09.807644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a025a6-9e8f-48e0-8ace-72b3496c1c0f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.825354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a025a6-9e8f-48e0-8ace-72b3496c1c0f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.892959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.893828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.894115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.894391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] PATH_INFO: `/v3/projects/ab53cc69f7b0424cb689317c4be9b685` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.896241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab53cc69f7b0424cb689317c4be9b685)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.898158 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.946732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab53cc69f7b0424cb689317c4be9b685', 'request_id': 'req-e2365068-584d-438d-844e-58c19804a2b8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.953322 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab53cc69f7b0424cb689317c4be9b685', 'request_id': 'req-e2365068-584d-438d-844e-58c19804a2b8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.961787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab53cc69f7b0424cb689317c4be9b685', 'request_id': 'req-e2365068-584d-438d-844e-58c19804a2b8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.972703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] The token cache is being invalidate because project ab53cc69f7b0424cb689317c4be9b685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:09.972994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.974956 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2365068-584d-438d-844e-58c19804a2b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:09.976812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1311/2605] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:09 2022] DELETE /identity/v3/projects/ab53cc69f7b0424cb689317c4be9b685 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:09.981874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a94bb-87d8-4a87-a9cb-f12d941a44c2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.982168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a94bb-87d8-4a87-a9cb-f12d941a44c2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.982446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a94bb-87d8-4a87-a9cb-f12d941a44c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.000097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2e3a94bb-87d8-4a87-a9cb-f12d941a44c2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:10.001302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e3a94bb-87d8-4a87-a9cb-f12d941a44c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:10.060968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1295/2606] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:10.069982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f312b-d7c1-4335-839d-e1e416422cfe None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.070296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f312b-d7c1-4335-839d-e1e416422cfe None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.070562 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f312b-d7c1-4335-839d-e1e416422cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.089919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e47f312b-d7c1-4335-839d-e1e416422cfe None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:10.091145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e47f312b-d7c1-4335-839d-e1e416422cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:10.099205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1312/2607] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:10.103846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a94bb-87d8-4a87-a9cb-f12d941a44c2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.114066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a94bb-87d8-4a87-a9cb-f12d941a44c2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.118912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.119608 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.119917 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.120246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.121051 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:10.121389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.123273 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.136946 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1296/2608] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:10.141253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f312b-d7c1-4335-839d-e1e416422cfe None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.151278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f312b-d7c1-4335-839d-e1e416422cfe None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.156085 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.156752 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.157039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.157331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.158014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.159940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.190059 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1313/2609] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:10 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:10.191173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.202196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc3699-11c6-409b-a89f-903b84ee6182 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.262787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.263493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.263862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.264286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.265106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.267456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.290570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1297/2610] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:10 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:09:10.294792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.305815 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95dfa-03eb-4bd0-98f7-1a0446dfe3c1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.310459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.311151 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.311437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.311714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.312595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.314195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.325256 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1314/2611] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:10.329364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.340444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e40a78-9702-40db-956a-9adbdef97fa7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.345194 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91038-085a-45ae-a737-305787f2c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.345855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91038-085a-45ae-a737-305787f2c929 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.346175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91038-085a-45ae-a737-305787f2c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.346428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91038-085a-45ae-a737-305787f2c929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.347165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a91038-085a-45ae-a737-305787f2c929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.349021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a91038-085a-45ae-a737-305787f2c929 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.363032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1298/2612] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:10.364573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.375614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ebe75-16a2-4e14-bb93-abfdf155ee47 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.381366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.382305 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.382601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.382894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] PATH_INFO: `/v3/projects/25d801e7845d4787b848eac2b8099cf3/users/70183a184e964f4db2e14b26309efd56/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.400363 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d801e7845d4787b848eac2b8099cf3, user_id=70183a184e964f4db2e14b26309efd56, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.403061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.412106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:10.417828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1315/2613] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:10 2022] PUT /identity/v3/projects/25d801e7845d4787b848eac2b8099cf3/users/70183a184e964f4db2e14b26309efd56/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:09:10.428490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1022a9-f878-4977-89ac-003c654f323b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.428779 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1022a9-f878-4977-89ac-003c654f323b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.429063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1022a9-f878-4977-89ac-003c654f323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.448812 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:10.459154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2e1022a9-f878-4977-89ac-003c654f323b None None] MFA Rules not processed for user `70183a184e964f4db2e14b26309efd56`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:10.460428 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e1022a9-f878-4977-89ac-003c654f323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:10.525390 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1299/2614] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:10.529781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.597166 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65348a-969b-4910-b10f-dc4d34cbe367 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.603749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.604488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.604758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.605070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.605770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.607847 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.636979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1316/2615] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:10 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:10.641875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1022a9-f878-4977-89ac-003c654f323b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.656792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1022a9-f878-4977-89ac-003c654f323b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.740381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.741109 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.741393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.741702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.743001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.744526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.783463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1300/2616] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:10 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:10.788899 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.804757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cad4e-fed2-4b08-a7d9-b4bac1b83b55 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.812826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.813521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.813819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.814321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.815164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.817324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.829981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1317/2617] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:09:10.834737 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.849312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fe71e-095a-46ec-bc31-e4ded4090a40 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.855061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.855908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.856229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.856504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] PATH_INFO: `/v3/projects/a0d0f95572b440ee91934ca115c3bf6b/users/56cdbd4fb7fd4a66b8932d37f6a948ef/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.878403 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d0f95572b440ee91934ca115c3bf6b, user_id=56cdbd4fb7fd4a66b8932d37f6a948ef, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.882343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.904372 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1301/2618] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:10 2022] PUT /identity/v3/projects/a0d0f95572b440ee91934ca115c3bf6b/users/56cdbd4fb7fd4a66b8932d37f6a948ef/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:10.905518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.917745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa0952-a502-460e-ae19-01cb3bfd9162 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.993868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d90a-7d95-4f2c-bd4a-984fcaf10af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.994622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d90a-7d95-4f2c-bd4a-984fcaf10af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.995074 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d90a-7d95-4f2c-bd4a-984fcaf10af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.995365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d90a-7d95-4f2c-bd4a-984fcaf10af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.996130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d90a-7d95-4f2c-bd4a-984fcaf10af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.998025 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d90a-7d95-4f2c-bd4a-984fcaf10af5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:11.012655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1318/2619] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:09:11.013878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:11.026713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2514-ffe0-4e55-9898-02bbf3a201ab admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:11.033407 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:11.035357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.036373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.036847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] PATH_INFO: `/v3/projects/a0d0f95572b440ee91934ca115c3bf6b/users/56cdbd4fb7fd4a66b8932d37f6a948ef/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.039642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d0f95572b440ee91934ca115c3bf6b, user_id=56cdbd4fb7fd4a66b8932d37f6a948ef, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:11.043599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:11.063274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1302/2620] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:11 2022] PUT /identity/v3/projects/a0d0f95572b440ee91934ca115c3bf6b/users/56cdbd4fb7fd4a66b8932d37f6a948ef/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:11.074310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846299c-8950-45be-918e-ac1947044373 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.074676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846299c-8950-45be-918e-ac1947044373 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.075793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846299c-8950-45be-918e-ac1947044373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.116706 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6846299c-8950-45be-918e-ac1947044373 None None] MFA Rules not processed for user `56cdbd4fb7fd4a66b8932d37f6a948ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:11.118790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6846299c-8950-45be-918e-ac1947044373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:11.229972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:11.242535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1319/2621] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:09:11.255961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:11.257742 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:11.333909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565161-90b7-47ee-b840-7d1545f73d76 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:11.339297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:11.339533 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.339899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.340757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.349398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:11.354471 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:11.357701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:11.370515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1303/2622] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:11.467918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846299c-8950-45be-918e-ac1947044373 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:11.480803 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846299c-8950-45be-918e-ac1947044373 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:11.484975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2fb8-c865-47f6-ad82-b8d0c112c5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:11.485846 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2fb8-c865-47f6-ad82-b8d0c112c5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.486204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2fb8-c865-47f6-ad82-b8d0c112c5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.486565 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2fb8-c865-47f6-ad82-b8d0c112c5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.558806 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2fb8-c865-47f6-ad82-b8d0c112c5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:11.560313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2fb8-c865-47f6-ad82-b8d0c112c5e5 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:11.571211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1320/2623] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:14.375095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:14.445543 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa138588-4271-4a4d-aac3-eade6d70ea1b service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:14.451593 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:14.453827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.454243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.454539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] PATH_INFO: `/v3/users/70183a184e964f4db2e14b26309efd56` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.455958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70183a184e964f4db2e14b26309efd56)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:14.457951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:14.531341 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70183a184e964f4db2e14b26309efd56'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:14.541598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70183a184e964f4db2e14b26309efd56'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:14.542522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70183a184e964f4db2e14b26309efd56'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:14.543281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70183a184e964f4db2e14b26309efd56'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:14.561771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70183a184e964f4db2e14b26309efd56'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:14.577318 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1304/2624] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:14 2022] DELETE /identity/v3/users/70183a184e964f4db2e14b26309efd56 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:14.582120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.582612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.582721 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.601183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:14.602705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:14.670513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1321/2625] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:14.681393 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:14.682796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:14.741762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1cce4-7342-4ab2-8a72-219fd8655f30 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:14.745555 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:14.746207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.746492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.746776 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.758531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:14.759944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:14.770962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1305/2626] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:15.040947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:15.042430 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:15.057878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32f35-2d83-412a-a2e2-716bccb62074 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:15.063868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:15.064777 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.065127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.065476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] PATH_INFO: `/v3/projects/25d801e7845d4787b848eac2b8099cf3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.066611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d801e7845d4787b848eac2b8099cf3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:15.069197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:15.118058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d801e7845d4787b848eac2b8099cf3', 'request_id': 'req-e73d1baf-4ab3-4b3e-885e-ac265583570d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.124304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d801e7845d4787b848eac2b8099cf3', 'request_id': 'req-e73d1baf-4ab3-4b3e-885e-ac265583570d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.132217 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d801e7845d4787b848eac2b8099cf3', 'request_id': 'req-e73d1baf-4ab3-4b3e-885e-ac265583570d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.142308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] The token cache is being invalidate because project 25d801e7845d4787b848eac2b8099cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:15.142595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.143258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.144837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1322/2627] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:15 2022] DELETE /identity/v3/projects/25d801e7845d4787b848eac2b8099cf3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:15.149859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:15.159723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733132-5141-4763-b1e1-59c6acd39b88 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:15.173112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:15.219863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:15.220765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.221048 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.221331 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] PATH_INFO: `/v3/users/56cdbd4fb7fd4a66b8932d37f6a948ef` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.222520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cdbd4fb7fd4a66b8932d37f6a948ef)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:15.225290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:15.273612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cdbd4fb7fd4a66b8932d37f6a948ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.281361 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cdbd4fb7fd4a66b8932d37f6a948ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.282094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cdbd4fb7fd4a66b8932d37f6a948ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.282691 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cdbd4fb7fd4a66b8932d37f6a948ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.295652 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88a2262b-99d7-437d-82d8-f73a8e3fb42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cdbd4fb7fd4a66b8932d37f6a948ef'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.308685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1306/2628] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:15 2022] DELETE /identity/v3/users/56cdbd4fb7fd4a66b8932d37f6a948ef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:15.593464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:15.595467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:15.621459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1baf-4ab3-4b3e-885e-ac265583570d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:15.638782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:15.710505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:15.711390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.712281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.712281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] PATH_INFO: `/v3/projects/a0d0f95572b440ee91934ca115c3bf6b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.713398 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d0f95572b440ee91934ca115c3bf6b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:15.715685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:15.794843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d0f95572b440ee91934ca115c3bf6b', 'request_id': 'req-3560b649-2e86-4024-b020-942eff2b1be8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.803682 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d0f95572b440ee91934ca115c3bf6b', 'request_id': 'req-3560b649-2e86-4024-b020-942eff2b1be8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.811961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d0f95572b440ee91934ca115c3bf6b', 'request_id': 'req-3560b649-2e86-4024-b020-942eff2b1be8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.824589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] The token cache is being invalidate because project a0d0f95572b440ee91934ca115c3bf6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:15.824887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.825553 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3560b649-2e86-4024-b020-942eff2b1be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:15.827373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1323/2629] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:15 2022] DELETE /identity/v3/projects/a0d0f95572b440ee91934ca115c3bf6b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:15.832036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1364d-5086-441b-beca-0a94d6e1c9ed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.832506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1364d-5086-441b-beca-0a94d6e1c9ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.832757 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1364d-5086-441b-beca-0a94d6e1c9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.850874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c2a1364d-5086-441b-beca-0a94d6e1c9ed None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:15.852418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c2a1364d-5086-441b-beca-0a94d6e1c9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:15.920231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1307/2630] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:15.930197 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25932c75-78be-4b66-a7ee-ad3141b9a317 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.930508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25932c75-78be-4b66-a7ee-ad3141b9a317 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.930794 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25932c75-78be-4b66-a7ee-ad3141b9a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.951180 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-25932c75-78be-4b66-a7ee-ad3141b9a317 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:15.952756 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-25932c75-78be-4b66-a7ee-ad3141b9a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:15.962232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1324/2631] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:15.966825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1364d-5086-441b-beca-0a94d6e1c9ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:15.978519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1364d-5086-441b-beca-0a94d6e1c9ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:15.983803 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:15.984846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.985183 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.985417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.986222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:15.986601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:15.988293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.001077 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1308/2632] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:16.006876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25932c75-78be-4b66-a7ee-ad3141b9a317 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.017314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25932c75-78be-4b66-a7ee-ad3141b9a317 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.022979 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.023641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.023924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.024255 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.024968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.026940 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.050144 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.053453 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:16.059327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1325/2633] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:16 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:16.063579 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.091042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:16.125767 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f932bd-fdd1-4334-b0ca-aec3d02bbadc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.141839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65827f6d-0f41-4066-88e2-48356836c249 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.147346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.147931 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.148968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.148968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.149224 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.151161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.172039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1326/2634] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:16 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:09:16.175984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.184148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bac8d-610d-48f2-9ab8-f533b8c776cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.184814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bac8d-610d-48f2-9ab8-f533b8c776cc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.185138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bac8d-610d-48f2-9ab8-f533b8c776cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.185456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bac8d-610d-48f2-9ab8-f533b8c776cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.186754 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783132e0-71c5-45be-921f-0aabc3dc9ccf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.187418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb1bac8d-610d-48f2-9ab8-f533b8c776cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:16.191462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.192165 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.192483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.192766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.194093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.195704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.198482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:16.210509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1327/2635] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:16.214832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.225072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e84ff-90e2-4efe-817f-4e4b5f208a1c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.230223 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.230955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.231333 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.231712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.232487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.234086 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.244249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1328/2636] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:09:16.248460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.250512 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bac8d-610d-48f2-9ab8-f533b8c776cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.251960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bac8d-610d-48f2-9ab8-f533b8c776cc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.259359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b14062-ca59-4a17-a5c1-3168875acce5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.262297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1309/2637] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:09:16.264131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.265014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.265315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.265596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] PATH_INFO: `/v3/projects/c911ff2d7cbe47e9a3d97b902666a5f4/users/19993b2075eb4974b52bc97949a29718/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.280812 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c911ff2d7cbe47e9a3d97b902666a5f4, user_id=19993b2075eb4974b52bc97949a29718, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.283406 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.297560 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1329/2638] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:16 2022] PUT /identity/v3/projects/c911ff2d7cbe47e9a3d97b902666a5f4/users/19993b2075eb4974b52bc97949a29718/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:09:16.308878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6f56-2bcb-4f2f-85c3-2122c60da840 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.309177 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6f56-2bcb-4f2f-85c3-2122c60da840 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.309519 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6f56-2bcb-4f2f-85c3-2122c60da840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.340113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-36bd6f56-2bcb-4f2f-85c3-2122c60da840 None None] MFA Rules not processed for user `19993b2075eb4974b52bc97949a29718`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:16.341424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-36bd6f56-2bcb-4f2f-85c3-2122c60da840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:16.411010 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1310/2639] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:16.415959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.480422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c6202-3e82-4eb2-98c8-19a19809bab0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.485126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.485796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.486084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.486366 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.487073 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.489029 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.520734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1330/2640] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:16 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:16.522440 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6f56-2bcb-4f2f-85c3-2122c60da840 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.533714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6f56-2bcb-4f2f-85c3-2122c60da840 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.555121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:16.605648 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.606873 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.607350 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.607835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.608874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.611753 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.633592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.635596 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:16.638903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1311/2641] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:16 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:16.640310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.656371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13daa65-c9a2-4707-85d7-26c7b83d73fd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.662312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.663021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.663309 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.663591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.664644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.666575 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.679222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1312/2642] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:16.683412 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.694399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff027-2ec5-43b3-bc85-8b65a0d7e17e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.701214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.702137 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.702431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.702719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] PATH_INFO: `/v3/projects/ba79ed4d2a5e449ea0206344fb6b0c7e/users/60fbb5c44c394a1d9b488e1d64f10d3a/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.720595 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba79ed4d2a5e449ea0206344fb6b0c7e, user_id=60fbb5c44c394a1d9b488e1d64f10d3a, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.723362 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.744867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1313/2643] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:16 2022] PUT /identity/v3/projects/ba79ed4d2a5e449ea0206344fb6b0c7e/users/60fbb5c44c394a1d9b488e1d64f10d3a/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:09:16.748581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.766415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116d2ad-a293-4c8e-8f0b-fc56857461ad admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.826080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84199152-1870-416e-8e5e-4b75480cd91a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.835134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.835952 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.836358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.836740 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.837707 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.839441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.852889 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1314/2644] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:09:16.855601 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:16.857929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.875962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb3be-86f5-4045-b986-e9fe866ea72a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.881947 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf5ce5-af63-4d36-b71a-b44bdf403c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.883243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf5ce5-af63-4d36-b71a-b44bdf403c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.883660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf5ce5-af63-4d36-b71a-b44bdf403c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.884178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf5ce5-af63-4d36-b71a-b44bdf403c6d admin admin] PATH_INFO: `/v3/projects/ba79ed4d2a5e449ea0206344fb6b0c7e/users/60fbb5c44c394a1d9b488e1d64f10d3a/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.888058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf5ce5-af63-4d36-b71a-b44bdf403c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba79ed4d2a5e449ea0206344fb6b0c7e, user_id=60fbb5c44c394a1d9b488e1d64f10d3a, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.890895 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf5ce5-af63-4d36-b71a-b44bdf403c6d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.900564 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.901415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.901709 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.901984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.904059 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1315/2645] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:16 2022] PUT /identity/v3/projects/ba79ed4d2a5e449ea0206344fb6b0c7e/users/60fbb5c44c394a1d9b488e1d64f10d3a/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:16.906792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:16.917026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2bb2-104d-45d9-9659-b25db22b6cf1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.917448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2bb2-104d-45d9-9659-b25db22b6cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.917850 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2bb2-104d-45d9-9659-b25db22b6cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.937034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.939341 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.970100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ea8d2bb2-104d-45d9-9659-b25db22b6cf1 None None] MFA Rules not processed for user `60fbb5c44c394a1d9b488e1d64f10d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:16.970100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ea8d2bb2-104d-45d9-9659-b25db22b6cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:16.983379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1331/2646] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:09:17.057193 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.092856 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1316/2647] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:17.105168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.106580 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:17.204734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9d0fc-0293-40ab-87ae-f6c8df58528a service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.318145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.319374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.319659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.319934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.385028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:17.386443 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:17.397997 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1332/2648] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:22.149998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2bb2-104d-45d9-9659-b25db22b6cf1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:22.160478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2bb2-104d-45d9-9659-b25db22b6cf1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:22.165021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:22.165703 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:22.166097 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:22.166269 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:22.176141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:22.177612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:22.190008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1317/2649] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:27.398131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=77 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:27.530317 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:27.590095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fddd7-983b-4054-9745-e0481060932f service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:27.594114 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:27.594804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:27.595090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:27.595373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:27.597244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:27.665576 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:27.667030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:27.677131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1333/2650] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:32.184491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=12 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:35.064699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:35.067207 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:35.083805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded75ef3-af54-49a1-a2ad-b5e2db9412de service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:35.090277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:35.092546 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:35.092830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:35.093118 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] PATH_INFO: `/v3/users/0c8a0ec84d3c471f9e6baa548f0d045a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:35.095153 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8a0ec84d3c471f9e6baa548f0d045a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:35.097478 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:35.162678 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8a0ec84d3c471f9e6baa548f0d045a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.173535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8a0ec84d3c471f9e6baa548f0d045a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.174231 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8a0ec84d3c471f9e6baa548f0d045a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.174908 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8a0ec84d3c471f9e6baa548f0d045a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.191896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8a0ec84d3c471f9e6baa548f0d045a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.207791 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1318/2651] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:35 2022] DELETE /identity/v3/users/0c8a0ec84d3c471f9e6baa548f0d045a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:35.397614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:35.416772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a1136-f306-4f00-9a0a-1588a4dc81ba service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:35.483505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:35.484382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:35.484675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:35.484955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] PATH_INFO: `/v3/projects/fce9015638524279b09969d5aacda2ba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:35.486380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce9015638524279b09969d5aacda2ba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:35.488325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:35.535328 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce9015638524279b09969d5aacda2ba', 'request_id': 'req-69b13328-2af6-4218-a6e5-de93d379234f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.537278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:35.544720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce9015638524279b09969d5aacda2ba', 'request_id': 'req-69b13328-2af6-4218-a6e5-de93d379234f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.554611 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce9015638524279b09969d5aacda2ba', 'request_id': 'req-69b13328-2af6-4218-a6e5-de93d379234f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.565655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] The token cache is being invalidate because project fce9015638524279b09969d5aacda2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:35.565975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.566667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.568289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1334/2652] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:35 2022] DELETE /identity/v3/projects/fce9015638524279b09969d5aacda2ba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:09:35.572325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:35.573871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:35.588229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9f9d-fa79-4bfe-8b25-54ec4ce2d923 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:35.646979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:35.647845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:35.648163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:35.648444 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] PATH_INFO: `/v3/users/cdd181daf69b4198929bea64402905e2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:35.650450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd181daf69b4198929bea64402905e2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:35.652398 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:35.698787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd181daf69b4198929bea64402905e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.705618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd181daf69b4198929bea64402905e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.706367 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd181daf69b4198929bea64402905e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.706990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd181daf69b4198929bea64402905e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.719802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e3464ef8-2a05-4d1b-b175-5514ed3c4024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd181daf69b4198929bea64402905e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:35.721814 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:35.736569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1319/2653] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:35 2022] DELETE /identity/v3/users/cdd181daf69b4198929bea64402905e2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:09:35.921758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:35.923304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:35.936880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b13328-2af6-4218-a6e5-de93d379234f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:36.000545 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:36.001462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:36.001774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:36.002019 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] PATH_INFO: `/v3/projects/be9c648c22834924abf2abc300b7e3ef` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:36.003288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9c648c22834924abf2abc300b7e3ef)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:36.005246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:36.054162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9c648c22834924abf2abc300b7e3ef', 'request_id': 'req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:36.060607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9c648c22834924abf2abc300b7e3ef', 'request_id': 'req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:36.068622 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9c648c22834924abf2abc300b7e3ef', 'request_id': 'req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:36.080287 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] The token cache is being invalidate because project be9c648c22834924abf2abc300b7e3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:36.080547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:36.081231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:36.083226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1335/2654] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:35 2022] DELETE /identity/v3/projects/be9c648c22834924abf2abc300b7e3ef => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:42.942171 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:42.942716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:42.942716 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:42.960498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:42.961706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:43.019592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1320/2655] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:09:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:43.070946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:43.072583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:43.153012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11f7d6-4883-4fd5-b9c7-7207b42e2fb9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:43.158066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c883977-4b46-414c-a2d2-9fff42fab33f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:43.158717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883977-4b46-414c-a2d2-9fff42fab33f service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:43.159082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883977-4b46-414c-a2d2-9fff42fab33f service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:43.159280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883977-4b46-414c-a2d2-9fff42fab33f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:43.169945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c883977-4b46-414c-a2d2-9fff42fab33f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:43.171526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c883977-4b46-414c-a2d2-9fff42fab33f service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:43.176361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:43.180863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1336/2656] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:09:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:09:53.012896 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=29 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:54.095322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:54.097062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:54.208280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ad915-55fc-46b1-bad6-e43504c317e6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:54.214948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:54.215861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:54.216251 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:54.216461 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] PATH_INFO: `/v3/users/19993b2075eb4974b52bc97949a29718` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:54.217704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19993b2075eb4974b52bc97949a29718)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:54.219931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:54.287164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19993b2075eb4974b52bc97949a29718'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:54.300502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19993b2075eb4974b52bc97949a29718'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:54.301837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19993b2075eb4974b52bc97949a29718'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:54.303120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19993b2075eb4974b52bc97949a29718'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:54.321545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19993b2075eb4974b52bc97949a29718'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:54.336690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1321/2657] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:54 2022] DELETE /identity/v3/users/19993b2075eb4974b52bc97949a29718 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:54.341924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:54.342530 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:54.342735 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:54.367558 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:54.368791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:54.458612 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1337/2658] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:54.472596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:54.474502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:54.561612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32dd8-d0cd-4539-982e-58f42e7fb05a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:54.565317 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:54.565983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:54.566265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:54.566545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:54.581749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:54.583526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:54.596143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1322/2659] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:54.986274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:54.988994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:55.013831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1960-9db3-4b5d-bce3-c849db5129c2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:55.038077 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:55.039954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.040725 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.041404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] PATH_INFO: `/v3/projects/c911ff2d7cbe47e9a3d97b902666a5f4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.043717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c911ff2d7cbe47e9a3d97b902666a5f4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:55.045993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:55.148193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c911ff2d7cbe47e9a3d97b902666a5f4', 'request_id': 'req-57676b75-3b92-4920-ad0e-c8b109f75102'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.159491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c911ff2d7cbe47e9a3d97b902666a5f4', 'request_id': 'req-57676b75-3b92-4920-ad0e-c8b109f75102'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.174683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c911ff2d7cbe47e9a3d97b902666a5f4', 'request_id': 'req-57676b75-3b92-4920-ad0e-c8b109f75102'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.193492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] The token cache is being invalidate because project c911ff2d7cbe47e9a3d97b902666a5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:55.193792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.194462 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.195948 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:55.196486 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1338/2660] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:54 2022] DELETE /identity/v3/projects/c911ff2d7cbe47e9a3d97b902666a5f4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:55.202751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:55.203261 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:55.206203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:55.220589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d1af-aa92-48b9-86d7-0ff9a2a3745b service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:55.247751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.322875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676b75-3b92-4920-ad0e-c8b109f75102 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:55.329209 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:55.330729 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.331229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.331683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] PATH_INFO: `/v3/users/c9bff88c59424542871b4a50e7526050` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.333439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:55.333591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bff88c59424542871b4a50e7526050)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:55.335129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.335741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.335992 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:55.336458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] PATH_INFO: `/v3/users/60fbb5c44c394a1d9b488e1d64f10d3a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.339733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fbb5c44c394a1d9b488e1d64f10d3a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:55.344098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:55.399427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.427241 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bff88c59424542871b4a50e7526050'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.440903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fbb5c44c394a1d9b488e1d64f10d3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.443925 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bff88c59424542871b4a50e7526050'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.445002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bff88c59424542871b4a50e7526050'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.446164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bff88c59424542871b4a50e7526050'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.456653 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fbb5c44c394a1d9b488e1d64f10d3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.466588 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fbb5c44c394a1d9b488e1d64f10d3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.479935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fbb5c44c394a1d9b488e1d64f10d3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.481260 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bff88c59424542871b4a50e7526050'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.482557 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdedb0b1-3689-4b62-b230-c2f2d10538b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fbb5c44c394a1d9b488e1d64f10d3a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:55.497483 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1339/2661] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:55 2022] DELETE /identity/v3/users/60fbb5c44c394a1d9b488e1d64f10d3a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:55.504614 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1323/2662] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:55 2022] DELETE /identity/v3/users/c9bff88c59424542871b4a50e7526050 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:09:55.513268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.513808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.514514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.539584 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:55.541734 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:55.634773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1340/2663] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:55.643584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:55.645348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:55.771646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f0506-3cf7-49c0-9bda-c3b81b7d95e4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:55.778325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ce0c9-42cb-45d9-8e3c-940a0c735f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:55.779008 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ce0c9-42cb-45d9-8e3c-940a0c735f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.780486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ce0c9-42cb-45d9-8e3c-940a0c735f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.780486 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ce0c9-42cb-45d9-8e3c-940a0c735f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.796809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ce0c9-42cb-45d9-8e3c-940a0c735f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:55.798867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ce0c9-42cb-45d9-8e3c-940a0c735f96 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:55.811028 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1324/2664] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:55.907245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:55.908783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:55.924190 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea333864-6f34-4f13-b8db-2e17cec58c11 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:55.930911 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:55.933918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.934268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.934704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] PATH_INFO: `/v3/projects/ba79ed4d2a5e449ea0206344fb6b0c7e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.936062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba79ed4d2a5e449ea0206344fb6b0c7e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:55.938400 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.041792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba79ed4d2a5e449ea0206344fb6b0c7e', 'request_id': 'req-5fea38c9-0ae1-48bf-9238-e116cf1b3651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.049980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba79ed4d2a5e449ea0206344fb6b0c7e', 'request_id': 'req-5fea38c9-0ae1-48bf-9238-e116cf1b3651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.060526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba79ed4d2a5e449ea0206344fb6b0c7e', 'request_id': 'req-5fea38c9-0ae1-48bf-9238-e116cf1b3651'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.087677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] The token cache is being invalidate because project ba79ed4d2a5e449ea0206344fb6b0c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:56.087980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.090457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5fea38c9-0ae1-48bf-9238-e116cf1b3651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.093072 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1341/2665] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:55 2022] DELETE /identity/v3/projects/ba79ed4d2a5e449ea0206344fb6b0c7e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:56.099381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.099681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.099978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.142877 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:56.143868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:56.205088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:56.239327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1325/2666] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:56.249337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb8505-a07e-4f65-b985-67be9d592d8f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.249919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb8505-a07e-4f65-b985-67be9d592d8f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.250402 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb8505-a07e-4f65-b985-67be9d592d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.282095 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3bdb8505-a07e-4f65-b985-67be9d592d8f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:56.284031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3bdb8505-a07e-4f65-b985-67be9d592d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:56.284211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.286495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:56.295316 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1342/2667] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:56.299648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb8505-a07e-4f65-b985-67be9d592d8f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.312586 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918cc5d-171a-4b42-aa30-0806aca9b925 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.313196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb8505-a07e-4f65-b985-67be9d592d8f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.321257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.324480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.324988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.325638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.326120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.328314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:56.328919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.329054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.329474 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.330063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] PATH_INFO: `/v3/projects/88b58a8808214295b8ee15083d0f2109` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.331674 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.332624 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b58a8808214295b8ee15083d0f2109)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.335299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.352262 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1343/2668] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:56.357435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.368849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb885c20-61dd-4b33-b932-82540269c0b3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.375508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.376236 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.376535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.376947 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.377655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.379770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.384466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:56.424415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1344/2669] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:56 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:56.424792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b58a8808214295b8ee15083d0f2109', 'request_id': 'req-212bef7f-2a86-4ed2-ab11-31649c4d1222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.427441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.431882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b58a8808214295b8ee15083d0f2109', 'request_id': 'req-212bef7f-2a86-4ed2-ab11-31649c4d1222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.439459 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b58a8808214295b8ee15083d0f2109', 'request_id': 'req-212bef7f-2a86-4ed2-ab11-31649c4d1222'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.455909 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] The token cache is being invalidate because project 88b58a8808214295b8ee15083d0f2109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:56.456328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.456929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.461463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1326/2670] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:56 2022] DELETE /identity/v3/projects/88b58a8808214295b8ee15083d0f2109 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:56.462907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.464585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:56.516304 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b87a7f-18d7-41da-a2c8-e6d51f856b5b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.521770 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.522485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.522829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.523139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.523753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.525773 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.553188 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1345/2671] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:56 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:56.563641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bef7f-2a86-4ed2-ab11-31649c4d1222 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.563880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.568136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:56.570995 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.571893 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.572221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.572504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] PATH_INFO: `/v3/users/af988acfc9a246f0be4fcab948af6cd1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.574343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af988acfc9a246f0be4fcab948af6cd1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.576551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.613750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a95b-8fee-4f5f-9c80-efeb0d06e8d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.625753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.626608 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.627028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.628659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.628659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.630356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.648430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af988acfc9a246f0be4fcab948af6cd1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.654103 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1346/2672] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:56.656038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.660277 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af988acfc9a246f0be4fcab948af6cd1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.661307 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af988acfc9a246f0be4fcab948af6cd1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.662228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af988acfc9a246f0be4fcab948af6cd1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.675080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899561fa-8c66-400c-8cc4-0c08bf885a48 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.679170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:56.682463 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af988acfc9a246f0be4fcab948af6cd1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:56.685210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d04937-6474-47df-a8b7-53c8ec843e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.686147 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d04937-6474-47df-a8b7-53c8ec843e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.686526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d04937-6474-47df-a8b7-53c8ec843e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.687116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d04937-6474-47df-a8b7-53c8ec843e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.688504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d04937-6474-47df-a8b7-53c8ec843e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.698218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d04937-6474-47df-a8b7-53c8ec843e63 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.703699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1327/2673] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:09:56 2022] DELETE /identity/v3/users/af988acfc9a246f0be4fcab948af6cd1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:56.718033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1347/2674] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:56.719618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:56.721328 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:56.825121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204064f3-337a-4ab5-93c1-b967b8fbd6a2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:56.833448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:56.834751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.835270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.835744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] PATH_INFO: `/v3/projects/520988138dc847a9a7b7c9a5207497e3/users/e6887ad19095491b9e6bbf5c923d5ed8/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.861787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] RBAC: Authorizing `identity:create_grant(project_id=520988138dc847a9a7b7c9a5207497e3, user_id=e6887ad19095491b9e6bbf5c923d5ed8, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:56.865884 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:56.886862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1328/2675] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:56 2022] PUT /identity/v3/projects/520988138dc847a9a7b7c9a5207497e3/users/e6887ad19095491b9e6bbf5c923d5ed8/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:56.904880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e088-22fc-41df-9b04-d08b25fae86a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:56.905388 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e088-22fc-41df-9b04-d08b25fae86a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:56.905928 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e088-22fc-41df-9b04-d08b25fae86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:56.973485 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b7d9e088-22fc-41df-9b04-d08b25fae86a None None] MFA Rules not processed for user `e6887ad19095491b9e6bbf5c923d5ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:56.974877 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b7d9e088-22fc-41df-9b04-d08b25fae86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:57.101715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1348/2676] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:57.102373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.108577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:57.123145 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9e088-22fc-41df-9b04-d08b25fae86a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.210360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:57.253408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9e088-22fc-41df-9b04-d08b25fae86a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.256805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b96f3-7a40-41b9-8a33-dda7fb69668e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.259391 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.260206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.260609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.261352 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.262321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.262531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.263560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.263844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.264157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] PATH_INFO: `/v3/projects/59a1532982944455a118ba19169e9fa9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.264280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.265540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a1532982944455a118ba19169e9fa9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.267528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.297473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1349/2677] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:57 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:57.302130 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.360116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a1532982944455a118ba19169e9fa9', 'request_id': 'req-795eb838-ff28-420f-97b4-ecd1c9ad20e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:57.379559 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a1532982944455a118ba19169e9fa9', 'request_id': 'req-795eb838-ff28-420f-97b4-ecd1c9ad20e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:57.387787 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a1532982944455a118ba19169e9fa9', 'request_id': 'req-795eb838-ff28-420f-97b4-ecd1c9ad20e2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:57.404163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:57.421334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] The token cache is being invalidate because project 59a1532982944455a118ba19169e9fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:09:57.421980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:57.423141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795eb838-ff28-420f-97b4-ecd1c9ad20e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:09:57.426626 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360636-3f0c-406e-aafc-6427e81188cc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.429424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1329/2678] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:09:57 2022] DELETE /identity/v3/projects/59a1532982944455a118ba19169e9fa9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:57.436330 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43239-10fc-45c3-9e39-74ab1fbc2e73 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.436671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43239-10fc-45c3-9e39-74ab1fbc2e73 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.436956 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43239-10fc-45c3-9e39-74ab1fbc2e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.468872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5ea43239-10fc-45c3-9e39-74ab1fbc2e73 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:57.470654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ea43239-10fc-45c3-9e39-74ab1fbc2e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:57.503968 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.504963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.505763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.506210 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.507099 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.509446 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.540083 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1350/2679] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:57 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:57.544024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.546708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:57.563409 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e7de-b9a8-4c40-b991-88ea8c0ee1f8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.567934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1330/2680] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:57.570778 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.571454 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.571925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.572215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.573036 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.575269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.577197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22472d-7446-483b-87db-25505c4ac0a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.577674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22472d-7446-483b-87db-25505c4ac0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.578078 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22472d-7446-483b-87db-25505c4ac0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.588090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1351/2681] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:57.592761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.601571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-be22472d-7446-483b-87db-25505c4ac0a4 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:57.602071 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-be22472d-7446-483b-87db-25505c4ac0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:57.607844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75d17e-8c16-473d-bd74-91412b501398 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.614618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.615672 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.616048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.616444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] PATH_INFO: `/v3/projects/7bf694c2e3a64decbfcc114b58e027ca/users/91414e3062314a93be7993b5d8b3413c/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.622402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1331/2682] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:09:57.627323 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22472d-7446-483b-87db-25505c4ac0a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.634187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf694c2e3a64decbfcc114b58e027ca, user_id=91414e3062314a93be7993b5d8b3413c, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.637527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.646147 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22472d-7446-483b-87db-25505c4ac0a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.654549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.655381 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.655730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.656165 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.657058 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:57.657504 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.659583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1352/2683] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:57 2022] PUT /identity/v3/projects/7bf694c2e3a64decbfcc114b58e027ca/users/91414e3062314a93be7993b5d8b3413c/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:57.659822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.663889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.685243 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1332/2684] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:57.687687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.702055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c9c2c-d694-4dab-838a-50f9cbb1d783 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.714892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:57.788051 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37148000-4f93-43bc-b2b7-78d58901bc24 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.793552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.794354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.794780 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.795135 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.795944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.797700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.807294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.808919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.809319 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.809640 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.810466 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.811981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1353/2685] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:09:57.812816 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.813284 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.823901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41551ff0-18eb-42f8-b6c7-f2d611442853 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.828704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dae7f-cc77-46c7-bd32-2dad9eeb7862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.829604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dae7f-cc77-46c7-bd32-2dad9eeb7862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.829879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dae7f-cc77-46c7-bd32-2dad9eeb7862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.830152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dae7f-cc77-46c7-bd32-2dad9eeb7862 admin admin] PATH_INFO: `/v3/projects/7bf694c2e3a64decbfcc114b58e027ca/users/91414e3062314a93be7993b5d8b3413c/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.832863 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dae7f-cc77-46c7-bd32-2dad9eeb7862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf694c2e3a64decbfcc114b58e027ca, user_id=91414e3062314a93be7993b5d8b3413c, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.835521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dae7f-cc77-46c7-bd32-2dad9eeb7862 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.850155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1354/2686] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:57 2022] PUT /identity/v3/projects/7bf694c2e3a64decbfcc114b58e027ca/users/91414e3062314a93be7993b5d8b3413c/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:57.863533 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.863909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.864299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.870076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1333/2687] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:57 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:57.871954 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:57.905696 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] MFA Rules not processed for user `91414e3062314a93be7993b5d8b3413c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:57.907514 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:57.965713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186008ee-dede-43d3-9310-bd4a75c87602 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:57.972654 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:57.973336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:57.975068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:57.975068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:57.975068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:57.977163 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:57.992903 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:58.009539 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1334/2688] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:57 2022] POST /identity/v3/users => generated 282 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:58.015969 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.033487 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd91fa-d878-456e-bc37-a0e187eca3d8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.034142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1355/2689] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:09:58.041566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.042473 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.043067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.043636 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.044534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.046346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.059670 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.062306 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:58.089578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1335/2690] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:58.098052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.116228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01227eea-6520-4286-a51f-2c21f86bb734 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.123162 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.125934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.126558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.127088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.128111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.130040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.147515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1336/2691] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:58.149389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.162281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d54bc-23a5-4c2d-bc15-df7df090c7ad admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.167470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.168918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.169213 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.169502 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] PATH_INFO: `/v3/projects/2d0217d7a7c646e7a07ee0246ff980a3/users/666884092bdd4ab1b7ee7864fa48beac/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.172302 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63bdd7-1e6c-4edc-abaa-9f8673712fcc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.179453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da03a0-0483-4b61-9f87-1b399c1d3838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.180697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da03a0-0483-4b61-9f87-1b399c1d3838 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.181505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da03a0-0483-4b61-9f87-1b399c1d3838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.181994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da03a0-0483-4b61-9f87-1b399c1d3838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.195986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0217d7a7c646e7a07ee0246ff980a3, user_id=666884092bdd4ab1b7ee7864fa48beac, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.199703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da03a0-0483-4b61-9f87-1b399c1d3838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.201015 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.201858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da03a0-0483-4b61-9f87-1b399c1d3838 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.217879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1356/2692] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:58.244741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1337/2693] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:58 2022] PUT /identity/v3/projects/2d0217d7a7c646e7a07ee0246ff980a3/users/666884092bdd4ab1b7ee7864fa48beac/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:58.247552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606889-99c5-4202-bc32-937a79217e98 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.247839 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606889-99c5-4202-bc32-937a79217e98 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.248253 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606889-99c5-4202-bc32-937a79217e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.284345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0b606889-99c5-4202-bc32-937a79217e98 None None] MFA Rules not processed for user `666884092bdd4ab1b7ee7864fa48beac`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:58.285570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0b606889-99c5-4202-bc32-937a79217e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:58.357081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:58.371063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.432185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1357/2694] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:09:58.433933 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606889-99c5-4202-bc32-937a79217e98 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.479131 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65985d6f-2344-4ed9-853a-3901aab0b85a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.487712 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.489042 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.489604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.490140 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.493530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:58.566833 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606889-99c5-4202-bc32-937a79217e98 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.581547 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.582204 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.582525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.582786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.583480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.585451 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.597257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.598830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.623713 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1338/2695] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:09:58.637020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1358/2696] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:09:58 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:58.641214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.653687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e73e9-98ac-4322-9953-4b6723ac6c5f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.733915 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.734696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.735053 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.735401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.736374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.738460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.760004 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:58.780569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1339/2697] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:09:58 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:09:58.783234 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.796858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa40277-4cc4-4b0b-a65e-e386d48b621d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.802178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.802875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.803161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.803440 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.804452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.807494 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.821501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1359/2698] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:58.825683 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.838763 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba847c-36a7-466b-923f-177bb4d97498 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.846808 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.847754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.848066 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.848397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] PATH_INFO: `/v3/projects/4f21292aede142f998dcea66c42d4235/users/bdc3410b9ccf47e49e3eba3ad76bff21/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.870114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f21292aede142f998dcea66c42d4235, user_id=bdc3410b9ccf47e49e3eba3ad76bff21, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.873738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.903929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1340/2699] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:58 2022] PUT /identity/v3/projects/4f21292aede142f998dcea66c42d4235/users/bdc3410b9ccf47e49e3eba3ad76bff21/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:58.909278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.931963 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab9588-0313-4ee2-aa0d-44f086da7208 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:59.070171 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f210-5a29-4dfc-b043-6bff1da4b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:59.071929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f210-5a29-4dfc-b043-6bff1da4b1db admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:59.072286 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f210-5a29-4dfc-b043-6bff1da4b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:59.072766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f210-5a29-4dfc-b043-6bff1da4b1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:59.074669 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f210-5a29-4dfc-b043-6bff1da4b1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:59.077269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f210-5a29-4dfc-b043-6bff1da4b1db admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:59.110270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1360/2700] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:59.111192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:59.123674 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435ba77-a04a-4515-80e1-61b62acca508 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:59.135728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:59.139675 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:59.139976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:59.140274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] PATH_INFO: `/v3/projects/4f21292aede142f998dcea66c42d4235/users/bdc3410b9ccf47e49e3eba3ad76bff21/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:59.146810 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f21292aede142f998dcea66c42d4235, user_id=bdc3410b9ccf47e49e3eba3ad76bff21, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:59.149545 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:59.165951 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1341/2701] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:09:59 2022] PUT /identity/v3/projects/4f21292aede142f998dcea66c42d4235/users/bdc3410b9ccf47e49e3eba3ad76bff21/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:59.177901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6154d3-a5f6-4217-a29a-1665a5288cd7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:59.178231 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6154d3-a5f6-4217-a29a-1665a5288cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:59.178491 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6154d3-a5f6-4217-a29a-1665a5288cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:59.251273 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0b6154d3-a5f6-4217-a29a-1665a5288cd7 None None] MFA Rules not processed for user `bdc3410b9ccf47e49e3eba3ad76bff21`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:59.252880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0b6154d3-a5f6-4217-a29a-1665a5288cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:59.312983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:59.369175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1361/2702] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:09:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:09:59.385982 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:59.473687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9b3d1-85e3-4d42-a947-701b22b1f84b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:59.477658 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:59.478274 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:59.478611 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:59.479023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:59.491741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:59.493418 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:59.506114 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1342/2703] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:09:59.642943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6154d3-a5f6-4217-a29a-1665a5288cd7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:59.656859 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6154d3-a5f6-4217-a29a-1665a5288cd7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:59.661845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06e003-967d-4a23-a853-68465e112808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:59.662470 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06e003-967d-4a23-a853-68465e112808 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:59.662916 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06e003-967d-4a23-a853-68465e112808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:59.663178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06e003-967d-4a23-a853-68465e112808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:59.740853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06e003-967d-4a23-a853-68465e112808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:59.742359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06e003-967d-4a23-a853-68465e112808 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:59.760055 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1362/2704] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:09:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:01.641443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:01.711906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2982a-e8e7-41c1-8949-1ab58cb4322d service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:01.717950 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:01.718844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:01.719130 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:01.719409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] PATH_INFO: `/v3/users/e6887ad19095491b9e6bbf5c923d5ed8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:01.720689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6887ad19095491b9e6bbf5c923d5ed8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:01.722765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:01.781601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6887ad19095491b9e6bbf5c923d5ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:01.793945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6887ad19095491b9e6bbf5c923d5ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:01.794793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6887ad19095491b9e6bbf5c923d5ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:01.795434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6887ad19095491b9e6bbf5c923d5ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:01.802960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:01.818633 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6887ad19095491b9e6bbf5c923d5ed8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:01.832408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1343/2705] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:01 2022] DELETE /identity/v3/users/e6887ad19095491b9e6bbf5c923d5ed8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:01.837090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:01.837614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:01.837742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:01.863955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:01.863955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:01.928510 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1363/2706] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:01.937334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:01.938960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:02.013792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc677d9-9f9a-4bf5-96a8-2215324fd906 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:02.017832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9b658-b164-4196-8217-1832241c8869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:02.018534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b658-b164-4196-8217-1832241c8869 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.018820 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b658-b164-4196-8217-1832241c8869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.019104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b658-b164-4196-8217-1832241c8869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.029800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9b658-b164-4196-8217-1832241c8869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:02.031267 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9b658-b164-4196-8217-1832241c8869 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:02.043721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1344/2707] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:02.342034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:02.344104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:02.350343 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.350714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.351131 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.358067 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcb77d-0244-4e19-8af3-2ca2e1ef01df None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:02.364769 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:02.365867 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.367034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.367323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] PATH_INFO: `/v3/projects/520988138dc847a9a7b7c9a5207497e3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.369277 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520988138dc847a9a7b7c9a5207497e3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:02.372096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:02.373581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:02.374960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:02.425934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520988138dc847a9a7b7c9a5207497e3', 'request_id': 'req-3b152df1-b27a-4733-b4ed-7c9dafdc1414'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.435121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520988138dc847a9a7b7c9a5207497e3', 'request_id': 'req-3b152df1-b27a-4733-b4ed-7c9dafdc1414'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.438061 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1345/2708] 10.222.0.69 () {58 vars in 967 bytes} [Thu May 26 18:10:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:02.443233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:02.452718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520988138dc847a9a7b7c9a5207497e3', 'request_id': 'req-3b152df1-b27a-4733-b4ed-7c9dafdc1414'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.457382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:02.468421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:02.470537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] The token cache is being invalidate because project 520988138dc847a9a7b7c9a5207497e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:02.470858 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.471529 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.475138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1364/2709] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:02 2022] DELETE /identity/v3/projects/520988138dc847a9a7b7c9a5207497e3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:02.479474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:02.481115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:02.566347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbf1b-73f9-4f2b-981f-88373141b094 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:02.595122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b152df1-b27a-4733-b4ed-7c9dafdc1414 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:02.600476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:02.601347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.601634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.601909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] PATH_INFO: `/v3/users/91414e3062314a93be7993b5d8b3413c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.602400 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:02.604222 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=91414e3062314a93be7993b5d8b3413c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:02.606326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:02.649047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220158-ac82-458b-a91d-87d150b27543 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:02.650425 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220158-ac82-458b-a91d-87d150b27543 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.650898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220158-ac82-458b-a91d-87d150b27543 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.651335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220158-ac82-458b-a91d-87d150b27543 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.654256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-95220158-ac82-458b-a91d-87d150b27543 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:02.662650 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91414e3062314a93be7993b5d8b3413c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.679711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91414e3062314a93be7993b5d8b3413c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.690163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91414e3062314a93be7993b5d8b3413c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.701374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91414e3062314a93be7993b5d8b3413c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.701927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91414e3062314a93be7993b5d8b3413c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:02.708704 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1365/2710] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:02 2022] DELETE /identity/v3/users/91414e3062314a93be7993b5d8b3413c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:10:02.733157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220158-ac82-458b-a91d-87d150b27543 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:02.735062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220158-ac82-458b-a91d-87d150b27543 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:02.744270 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1346/2711] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:10:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:10:03.038475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.040921 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:03.145296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9bafc-0abd-4ced-83fb-b129f03ee0da admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.154242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.155206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.155496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.155779 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] PATH_INFO: `/v3/projects/7bf694c2e3a64decbfcc114b58e027ca` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.157093 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf694c2e3a64decbfcc114b58e027ca)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.159056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.172268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:03.236632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf694c2e3a64decbfcc114b58e027ca', 'request_id': 'req-2044f91c-e68a-45d6-ab75-1839030022d1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:03.245007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf694c2e3a64decbfcc114b58e027ca', 'request_id': 'req-2044f91c-e68a-45d6-ab75-1839030022d1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:03.254537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf694c2e3a64decbfcc114b58e027ca', 'request_id': 'req-2044f91c-e68a-45d6-ab75-1839030022d1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:03.266163 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] The token cache is being invalidate because project 7bf694c2e3a64decbfcc114b58e027ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:03.266436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:03.267124 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2044f91c-e68a-45d6-ab75-1839030022d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:03.268722 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1366/2712] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:03 2022] DELETE /identity/v3/projects/7bf694c2e3a64decbfcc114b58e027ca => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:03.273790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f586c-2143-4fd3-9ab2-a3dfe8053ee6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.274103 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f586c-2143-4fd3-9ab2-a3dfe8053ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.274389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f586c-2143-4fd3-9ab2-a3dfe8053ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.294761 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a94f586c-2143-4fd3-9ab2-a3dfe8053ee6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:03.295958 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a94f586c-2143-4fd3-9ab2-a3dfe8053ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:03.356801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1347/2713] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:03.365062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1c9d-7251-437c-a3dd-923aea844ca7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.365361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1c9d-7251-437c-a3dd-923aea844ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.365681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1c9d-7251-437c-a3dd-923aea844ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.383821 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a45e1c9d-7251-437c-a3dd-923aea844ca7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:03.385057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a45e1c9d-7251-437c-a3dd-923aea844ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:03.393380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1367/2714] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:03.397516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f586c-2143-4fd3-9ab2-a3dfe8053ee6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.408265 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f586c-2143-4fd3-9ab2-a3dfe8053ee6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.412815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.413460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.413741 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.414015 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.414738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:03.415047 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.416695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.429481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1348/2715] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:03.434028 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1c9d-7251-437c-a3dd-923aea844ca7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.443605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1c9d-7251-437c-a3dd-923aea844ca7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.448303 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.448961 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.449276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.449795 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.450315 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.452258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.479284 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1368/2716] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:03 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:03.484256 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.494594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a802c9c-c8c3-4680-ad5e-6c6480aafb27 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.547686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:03.555336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.556023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.556345 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.556632 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.557376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.559422 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.581905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1349/2717] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:03 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:03.583110 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.594313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea2a4-4fbd-49ff-9a11-597af1ded259 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.599038 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.599703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.599994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.600326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.601070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.602662 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.615713 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1369/2718] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:03.619837 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.630268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52337e-1fff-4f8b-895f-fd75f0a921e2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.634983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af5aad-3a92-4d47-b5fa-1f9ac89e93d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.635642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5aad-3a92-4d47-b5fa-1f9ac89e93d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.635928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5aad-3a92-4d47-b5fa-1f9ac89e93d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.636238 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5aad-3a92-4d47-b5fa-1f9ac89e93d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.637018 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af5aad-3a92-4d47-b5fa-1f9ac89e93d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.638612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af5aad-3a92-4d47-b5fa-1f9ac89e93d8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.648759 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1350/2719] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:03.653661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.663619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b9601-147c-4f56-8b2e-dd979e283c68 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.669689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.670567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.670853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.671136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] PATH_INFO: `/v3/projects/da581d8cfd2b49c49a9b9e108594a3b5/users/844694f8a1fb49bcaf0bc88c48b6e01a/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.687407 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da581d8cfd2b49c49a9b9e108594a3b5, user_id=844694f8a1fb49bcaf0bc88c48b6e01a, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.690156 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.704199 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1370/2720] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:03 2022] PUT /identity/v3/projects/da581d8cfd2b49c49a9b9e108594a3b5/users/844694f8a1fb49bcaf0bc88c48b6e01a/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:03.715744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221136ec-35f6-4b79-926b-650e83e7ef56 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.716339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221136ec-35f6-4b79-926b-650e83e7ef56 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.716339 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221136ec-35f6-4b79-926b-650e83e7ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.747288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-221136ec-35f6-4b79-926b-650e83e7ef56 None None] MFA Rules not processed for user `844694f8a1fb49bcaf0bc88c48b6e01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:03.748515 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-221136ec-35f6-4b79-926b-650e83e7ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:03.817034 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1351/2721] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:03.821811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.897698 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5f71-74ac-429f-975f-cb04b851b95f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:03.903281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:03.903966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:03.904290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:03.904573 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:03.905312 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:03.907248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:03.935687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1371/2722] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:03 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:03.940172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221136ec-35f6-4b79-926b-650e83e7ef56 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:03.951931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221136ec-35f6-4b79-926b-650e83e7ef56 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.008916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.009507 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.009799 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.010083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.010790 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:04.013612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:04.035264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1352/2723] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:03 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:04.039416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:04.050100 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b8287-94b3-4b10-a95e-04c5692f285a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.054881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.055548 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.055837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.056157 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.056890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:04.059010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:04.071037 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1372/2724] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:04.075793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:04.093687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9234d-d707-43f3-b206-4d42624aad67 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.098509 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.099405 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.099696 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.099979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] PATH_INFO: `/v3/projects/a18d8a1bda1c409a96b3ecaea7bf4cc7/users/b434d8f4311a44729607ee6270c50fba/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.118702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d8a1bda1c409a96b3ecaea7bf4cc7, user_id=b434d8f4311a44729607ee6270c50fba, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:04.122133 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:04.136456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1353/2725] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:04 2022] PUT /identity/v3/projects/a18d8a1bda1c409a96b3ecaea7bf4cc7/users/b434d8f4311a44729607ee6270c50fba/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:04.141347 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:04.152090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff88b-07f9-46cc-83aa-55ed8bf88edb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.157787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:04.219614 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee1ae9-0d3e-4bad-a7b6-46ddf925f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.220331 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1ae9-0d3e-4bad-a7b6-46ddf925f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.220617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1ae9-0d3e-4bad-a7b6-46ddf925f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.220925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1ae9-0d3e-4bad-a7b6-46ddf925f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.221657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee1ae9-0d3e-4bad-a7b6-46ddf925f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:04.223244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee1ae9-0d3e-4bad-a7b6-46ddf925f7b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:04.235061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1373/2726] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:04.240217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:04.255605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee8e1a-785a-4ff6-972c-09d3dcbf33e8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.260744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.261570 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.262736 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.263228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] PATH_INFO: `/v3/projects/a18d8a1bda1c409a96b3ecaea7bf4cc7/users/b434d8f4311a44729607ee6270c50fba/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.265480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d8a1bda1c409a96b3ecaea7bf4cc7, user_id=b434d8f4311a44729607ee6270c50fba, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:04.268221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:04.285340 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1354/2727] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:04 2022] PUT /identity/v3/projects/a18d8a1bda1c409a96b3ecaea7bf4cc7/users/b434d8f4311a44729607ee6270c50fba/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:04.296936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3de3-7ccd-467e-8996-2f641cc8b431 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.298020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3de3-7ccd-467e-8996-2f641cc8b431 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.298539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3de3-7ccd-467e-8996-2f641cc8b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.348843 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ae6f3de3-7ccd-467e-8996-2f641cc8b431 None None] MFA Rules not processed for user `b434d8f4311a44729607ee6270c50fba`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:04.350919 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ae6f3de3-7ccd-467e-8996-2f641cc8b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:04.435042 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1374/2728] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:04.446939 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:04.450020 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:04.487857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:04.532771 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc367-7894-4a8a-b9ce-7ec6ff0ff425 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.536864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a82f70-cced-4f85-8647-0baebfd495de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.537527 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a82f70-cced-4f85-8647-0baebfd495de service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.537815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a82f70-cced-4f85-8647-0baebfd495de service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.538116 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a82f70-cced-4f85-8647-0baebfd495de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.548764 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a82f70-cced-4f85-8647-0baebfd495de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:04.550280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a82f70-cced-4f85-8647-0baebfd495de service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:04.561538 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1355/2729] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:04.956244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3de3-7ccd-467e-8996-2f641cc8b431 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.034075 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3de3-7ccd-467e-8996-2f641cc8b431 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.038532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.039404 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.039681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.040356 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] PATH_INFO: `/v3/users/844694f8a1fb49bcaf0bc88c48b6e01a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.041208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844694f8a1fb49bcaf0bc88c48b6e01a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.043817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.078964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:05.094118 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844694f8a1fb49bcaf0bc88c48b6e01a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.109346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844694f8a1fb49bcaf0bc88c48b6e01a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.116800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844694f8a1fb49bcaf0bc88c48b6e01a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.125201 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844694f8a1fb49bcaf0bc88c48b6e01a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.125980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844694f8a1fb49bcaf0bc88c48b6e01a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.133003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1375/2730] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:04 2022] DELETE /identity/v3/users/844694f8a1fb49bcaf0bc88c48b6e01a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:05.137819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.137819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.137819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.157698 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:05.158867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:05.221830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1356/2731] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:05.232003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.234290 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:05.299689 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d1ae-83a8-4731-9d1d-d1c2c7e825e1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.303903 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.304703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.304994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.305270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.315776 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.317298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.329241 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1376/2732] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:05.689572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.691247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:05.705702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f6c5-04f0-4294-98b9-937e568932ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.711401 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.711815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.712150 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.712430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] PATH_INFO: `/v3/projects/da581d8cfd2b49c49a9b9e108594a3b5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.713805 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da581d8cfd2b49c49a9b9e108594a3b5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.715749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.773979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da581d8cfd2b49c49a9b9e108594a3b5', 'request_id': 'req-5ab039ab-1b76-47ab-9941-5ab52984a0b6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.782288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da581d8cfd2b49c49a9b9e108594a3b5', 'request_id': 'req-5ab039ab-1b76-47ab-9941-5ab52984a0b6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.790212 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da581d8cfd2b49c49a9b9e108594a3b5', 'request_id': 'req-5ab039ab-1b76-47ab-9941-5ab52984a0b6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.803793 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] The token cache is being invalidate because project da581d8cfd2b49c49a9b9e108594a3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:05.804143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.804886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.806612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1357/2733] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:05 2022] DELETE /identity/v3/projects/da581d8cfd2b49c49a9b9e108594a3b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:05.811405 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.822552 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32c250-f5b7-4504-9342-0891551c108c service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.885855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.886909 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.887824 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.888281 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] PATH_INFO: `/v3/users/b434d8f4311a44729607ee6270c50fba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.889635 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b434d8f4311a44729607ee6270c50fba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.891613 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.944452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b434d8f4311a44729607ee6270c50fba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.952856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:05.965226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b434d8f4311a44729607ee6270c50fba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.973521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b434d8f4311a44729607ee6270c50fba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.981991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b434d8f4311a44729607ee6270c50fba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.982710 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-29b48aae-2b3a-499a-81e7-49010f5f5020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b434d8f4311a44729607ee6270c50fba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:05.989142 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1377/2734] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:05 2022] DELETE /identity/v3/users/b434d8f4311a44729607ee6270c50fba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:06.313500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:06.315335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:06.331492 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab039ab-1b76-47ab-9941-5ab52984a0b6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:06.384998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:06.404288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:06.405164 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:06.405454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:06.405739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] PATH_INFO: `/v3/projects/a18d8a1bda1c409a96b3ecaea7bf4cc7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:06.407002 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18d8a1bda1c409a96b3ecaea7bf4cc7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:06.409068 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:06.475106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18d8a1bda1c409a96b3ecaea7bf4cc7', 'request_id': 'req-97edc0be-c5a8-458d-998c-a87e5180c057'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:06.487898 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18d8a1bda1c409a96b3ecaea7bf4cc7', 'request_id': 'req-97edc0be-c5a8-458d-998c-a87e5180c057'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:06.496752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18d8a1bda1c409a96b3ecaea7bf4cc7', 'request_id': 'req-97edc0be-c5a8-458d-998c-a87e5180c057'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:06.509383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] The token cache is being invalidate because project a18d8a1bda1c409a96b3ecaea7bf4cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:06.509682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:06.510346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-97edc0be-c5a8-458d-998c-a87e5180c057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:06.512032 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1358/2735] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:06 2022] DELETE /identity/v3/projects/a18d8a1bda1c409a96b3ecaea7bf4cc7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:06.516981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6517-96ff-4cb6-bb45-bf9889be25fc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:06.517484 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6517-96ff-4cb6-bb45-bf9889be25fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:06.517604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6517-96ff-4cb6-bb45-bf9889be25fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:06.539014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ec1c6517-96ff-4cb6-bb45-bf9889be25fc None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:06.540313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ec1c6517-96ff-4cb6-bb45-bf9889be25fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:06.624581 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1378/2736] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:06.626986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129797-53d1-44cc-ba13-daaa68668b37 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:06.627925 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129797-53d1-44cc-ba13-daaa68668b37 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:06.628152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129797-53d1-44cc-ba13-daaa68668b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:06.650616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a4129797-53d1-44cc-ba13-daaa68668b37 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:06.651862 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a4129797-53d1-44cc-ba13-daaa68668b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:06.670601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1359/2737] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:06.672444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6517-96ff-4cb6-bb45-bf9889be25fc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:06.685069 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6517-96ff-4cb6-bb45-bf9889be25fc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:06.699048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:06.701441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:06.702215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:06.702986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:06.704350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:06.704875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:06.706766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:06.725351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1379/2738] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:06.730818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129797-53d1-44cc-ba13-daaa68668b37 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:06.747720 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129797-53d1-44cc-ba13-daaa68668b37 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:06.761809 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:06.763235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:06.763582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:06.763806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:06.766991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:06.769070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:06.799971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1360/2739] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:06 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:06.806952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:06.829173 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb0bc-927c-48d7-9ba2-bb829c8a7af3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:06.929410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:06.930140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:06.930431 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:06.930717 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:06.931466 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:06.933607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:06.961488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1380/2740] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:06 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:06.966416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:06.979246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bb1cd-3456-4233-8a15-df932382f006 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:06.991313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:06.992259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:06.992577 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:06.992865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:06.993751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:06.995715 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:07.024259 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1361/2741] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:07.026646 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:07.049066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd2b86-ab64-43fc-9632-5b59b0ee7a16 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:07.056283 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448211d-4e43-4609-af9d-6e34a7541c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:07.057185 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448211d-4e43-4609-af9d-6e34a7541c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.057740 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448211d-4e43-4609-af9d-6e34a7541c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.058089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448211d-4e43-4609-af9d-6e34a7541c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.059512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448211d-4e43-4609-af9d-6e34a7541c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:07.061718 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448211d-4e43-4609-af9d-6e34a7541c36 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:07.084234 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1381/2742] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:07.086227 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:07.106059 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e1126-c8fc-4aec-95b2-71ecb433c788 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:07.115324 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:07.116935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.117446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.117944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] PATH_INFO: `/v3/projects/0d34bc12495f4446a3be7b882aea1216/users/6f7b0be45f2c47abb00981002f68d5c2/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.138181 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d34bc12495f4446a3be7b882aea1216, user_id=6f7b0be45f2c47abb00981002f68d5c2, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:07.140953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:07.157040 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1362/2743] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:07 2022] PUT /identity/v3/projects/0d34bc12495f4446a3be7b882aea1216/users/6f7b0be45f2c47abb00981002f68d5c2/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:07.169126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.169758 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.170030 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.172530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:07.175258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:07.203531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] MFA Rules not processed for user `6f7b0be45f2c47abb00981002f68d5c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:07.204808 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:07.231468 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:07.253376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed1b4-c6c4-408c-9602-6995ceff18b5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:07.259325 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:07.260254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.260548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.260827 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] PATH_INFO: `/v3/users/6ab7e96c0db34764bc2ac1e20d0ac35e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.263026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab7e96c0db34764bc2ac1e20d0ac35e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:07.265054 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:07.279981 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:07.281585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1382/2744] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:07.292888 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:07.295115 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:07.326178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab7e96c0db34764bc2ac1e20d0ac35e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.335292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab7e96c0db34764bc2ac1e20d0ac35e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.335987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab7e96c0db34764bc2ac1e20d0ac35e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.336711 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab7e96c0db34764bc2ac1e20d0ac35e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.353039 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab7e96c0db34764bc2ac1e20d0ac35e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.373183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fd71d-d8ba-4e56-a1c4-4b64447024f7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:07.376480 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1363/2745] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:07 2022] DELETE /identity/v3/users/6ab7e96c0db34764bc2ac1e20d0ac35e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:07.380531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28157caf-7636-4215-90ff-583fff77ec31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:07.380989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157caf-7636-4215-90ff-583fff77ec31 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.381389 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157caf-7636-4215-90ff-583fff77ec31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.381729 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157caf-7636-4215-90ff-583fff77ec31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.383637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-28157caf-7636-4215-90ff-583fff77ec31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:07.396390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28157caf-7636-4215-90ff-583fff77ec31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:07.397889 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28157caf-7636-4215-90ff-583fff77ec31 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:07.408113 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1383/2746] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:07.588738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:07.592352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:07.689305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afad3a-f375-4c9e-ab8b-eb3fd9dea431 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:07.708569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:07.708569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.708569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.708569 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] PATH_INFO: `/v3/projects/f6805a7efbeb448d8bc42a86ff756071` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.709298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6805a7efbeb448d8bc42a86ff756071)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:07.709298 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:07.785086 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6805a7efbeb448d8bc42a86ff756071', 'request_id': 'req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.793708 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6805a7efbeb448d8bc42a86ff756071', 'request_id': 'req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.799986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6805a7efbeb448d8bc42a86ff756071', 'request_id': 'req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.812855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] The token cache is being invalidate because project f6805a7efbeb448d8bc42a86ff756071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:07.813154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.813826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc6d93b2-b6d2-4a3d-b38e-be76de006cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:07.815430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1364/2747] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:07 2022] DELETE /identity/v3/projects/f6805a7efbeb448d8bc42a86ff756071 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:07.820811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47180d6-4ed0-4cd2-bb8a-9099164f3fdd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.821387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47180d6-4ed0-4cd2-bb8a-9099164f3fdd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.821387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47180d6-4ed0-4cd2-bb8a-9099164f3fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.840853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c47180d6-4ed0-4cd2-bb8a-9099164f3fdd None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:07.842131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c47180d6-4ed0-4cd2-bb8a-9099164f3fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:07.908974 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1384/2748] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:07.917003 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb1ca-6706-4167-a3b8-1d48016ed339 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.917432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb1ca-6706-4167-a3b8-1d48016ed339 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.917847 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb1ca-6706-4167-a3b8-1d48016ed339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.939922 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4a5eb1ca-6706-4167-a3b8-1d48016ed339 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:07.941145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4a5eb1ca-6706-4167-a3b8-1d48016ed339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:07.952441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1365/2749] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:07.956845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47180d6-4ed0-4cd2-bb8a-9099164f3fdd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:07.967368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47180d6-4ed0-4cd2-bb8a-9099164f3fdd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:07.972444 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:07.973126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:07.973412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:07.973694 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:07.974436 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:07.974957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:07.976684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:07.990479 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1385/2750] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:07.995076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb1ca-6706-4167-a3b8-1d48016ed339 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:08.006396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb1ca-6706-4167-a3b8-1d48016ed339 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:08.011371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:08.012634 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:08.013653 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:08.013938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:08.014642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:08.016606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:08.029252 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:08.053930 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1366/2751] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:07 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:08.058480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:08.070786 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba302f67-f0cd-44b8-bfe4-202f24b00637 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:08.138149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:08.149876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:08.151550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:08.152423 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:08.153010 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:08.154559 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:08.158350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:08.190685 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1386/2752] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:08 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:08.195178 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:08.208286 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8972-4964-4b0a-b27e-3de12b8ac36a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:08.213566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:08.214185 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:08.214806 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:08.215094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:08.216244 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:08.218111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:08.230551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1367/2753] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:08.239617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:08.251377 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99de941-15a4-4916-be4d-fb971366dc8e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:08.257291 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001720a-03c2-4f90-99c5-25cda64caed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:08.258129 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001720a-03c2-4f90-99c5-25cda64caed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:08.258522 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001720a-03c2-4f90-99c5-25cda64caed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:08.258861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001720a-03c2-4f90-99c5-25cda64caed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:08.259641 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001720a-03c2-4f90-99c5-25cda64caed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:08.261326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001720a-03c2-4f90-99c5-25cda64caed9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:08.272516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1387/2754] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:08.276804 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:08.288357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601943-7868-49a4-8db3-918a0f12c47d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:08.294283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:08.295206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:08.295489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:08.295777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] PATH_INFO: `/v3/projects/5eefb86101fe49f9953595f91d4a790a/users/e6d5c34aba8047e593b32ec34ab7fba9/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:08.314084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eefb86101fe49f9953595f91d4a790a, user_id=e6d5c34aba8047e593b32ec34ab7fba9, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:08.316840 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:08.331552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1368/2755] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:08 2022] PUT /identity/v3/projects/5eefb86101fe49f9953595f91d4a790a/users/e6d5c34aba8047e593b32ec34ab7fba9/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:08.337574 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:08.337837 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:08.338049 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:08.358727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:08.360374 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:08.439955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1388/2756] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:08.449811 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:08.451807 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:08.516264 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1faca-4060-4f22-bd59-490352b49e50 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:08.520157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08514-aaca-4e4b-9095-f0510fc54fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:08.520813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08514-aaca-4e4b-9095-f0510fc54fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:08.521095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08514-aaca-4e4b-9095-f0510fc54fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:08.521379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08514-aaca-4e4b-9095-f0510fc54fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:08.531673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c08514-aaca-4e4b-9095-f0510fc54fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:08.533168 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c08514-aaca-4e4b-9095-f0510fc54fd5 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:08.543152 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1369/2757] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:09.487924 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:09.489677 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:09.504090 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fa03c-cc93-4b0d-babf-7efea8a1c05d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:09.509208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:09.510104 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:09.510387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:09.510668 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] PATH_INFO: `/v3/users/666884092bdd4ab1b7ee7864fa48beac` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:09.512109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666884092bdd4ab1b7ee7864fa48beac)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:09.514727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:09.570457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666884092bdd4ab1b7ee7864fa48beac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:09.588132 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666884092bdd4ab1b7ee7864fa48beac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:09.602716 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666884092bdd4ab1b7ee7864fa48beac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:09.622351 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666884092bdd4ab1b7ee7864fa48beac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:09.624475 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666884092bdd4ab1b7ee7864fa48beac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:09.636761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1389/2758] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:09 2022] DELETE /identity/v3/users/666884092bdd4ab1b7ee7864fa48beac => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:10:09.644596 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:09.645551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:09.645551 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:09.671681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:09.672971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:09.778822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1370/2759] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:09.791631 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:09.795424 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:09.865630 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:09.873458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22fb7-c0af-4f6e-b7d0-457ff5a9e882 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:09.879412 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:09.880875 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:09.881252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:09.881691 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:09.894887 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:09.896844 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:09.910043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1390/2760] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:10.282382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:10.284247 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:10.307964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2678-d3db-46d0-9e5e-d4bada8a2b16 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:10.332758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:10.334076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:10.335695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:10.336302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] PATH_INFO: `/v3/projects/2d0217d7a7c646e7a07ee0246ff980a3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:10.337919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0217d7a7c646e7a07ee0246ff980a3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:10.340060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:10.406472 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0217d7a7c646e7a07ee0246ff980a3', 'request_id': 'req-2b282336-1590-4193-841f-abecb52c0c68'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.411233 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:10.416187 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0217d7a7c646e7a07ee0246ff980a3', 'request_id': 'req-2b282336-1590-4193-841f-abecb52c0c68'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.431919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0217d7a7c646e7a07ee0246ff980a3', 'request_id': 'req-2b282336-1590-4193-841f-abecb52c0c68'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.448762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] The token cache is being invalidate because project 2d0217d7a7c646e7a07ee0246ff980a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:10.449145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.451530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.453493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1371/2761] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:10 2022] DELETE /identity/v3/projects/2d0217d7a7c646e7a07ee0246ff980a3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:10.457325 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:10.470297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77864409-52b6-4262-afb7-83179db16a33 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:10.571469 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:10.573105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:10.573105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:10.573105 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] PATH_INFO: `/v3/users/bdc3410b9ccf47e49e3eba3ad76bff21` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:10.577203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc3410b9ccf47e49e3eba3ad76bff21)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:10.577203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:10.657714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc3410b9ccf47e49e3eba3ad76bff21'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.682039 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc3410b9ccf47e49e3eba3ad76bff21'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.704595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc3410b9ccf47e49e3eba3ad76bff21'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.715161 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc3410b9ccf47e49e3eba3ad76bff21'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.716910 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-201cdc16-b181-480e-953d-dfdefcde1326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc3410b9ccf47e49e3eba3ad76bff21'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:10.724054 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1391/2762] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:10 2022] DELETE /identity/v3/users/bdc3410b9ccf47e49e3eba3ad76bff21 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:11.305928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:11.308535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:11.362734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282336-1590-4193-841f-abecb52c0c68 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:11.491347 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:11.492302 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:11.492588 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:11.492865 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] PATH_INFO: `/v3/projects/4f21292aede142f998dcea66c42d4235` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:11.494441 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f21292aede142f998dcea66c42d4235)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:11.497527 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:11.572434 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f21292aede142f998dcea66c42d4235', 'request_id': 'req-b629b07a-0c25-4cb0-9eec-063b128a8841'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:11.583352 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f21292aede142f998dcea66c42d4235', 'request_id': 'req-b629b07a-0c25-4cb0-9eec-063b128a8841'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:11.594823 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f21292aede142f998dcea66c42d4235', 'request_id': 'req-b629b07a-0c25-4cb0-9eec-063b128a8841'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:11.610355 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] The token cache is being invalidate because project 4f21292aede142f998dcea66c42d4235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:11.610774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:11.611760 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b629b07a-0c25-4cb0-9eec-063b128a8841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:11.617605 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1372/2763] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:11 2022] DELETE /identity/v3/projects/4f21292aede142f998dcea66c42d4235 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:11.619382 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdace1a-1b03-4c6a-9ef5-79fd4fcbe467 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:11.619857 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdace1a-1b03-4c6a-9ef5-79fd4fcbe467 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:11.619962 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdace1a-1b03-4c6a-9ef5-79fd4fcbe467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:11.641359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9cdace1a-1b03-4c6a-9ef5-79fd4fcbe467 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:11.642791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9cdace1a-1b03-4c6a-9ef5-79fd4fcbe467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:11.764068 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1392/2764] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:11.775156 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b14fb1-30b0-4b48-949f-fbf7ea174e0f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:11.775450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b14fb1-30b0-4b48-949f-fbf7ea174e0f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:11.775737 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b14fb1-30b0-4b48-949f-fbf7ea174e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:11.809085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-08b14fb1-30b0-4b48-949f-fbf7ea174e0f None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:11.812221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08b14fb1-30b0-4b48-949f-fbf7ea174e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:11.828186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1373/2765] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:11.831664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdace1a-1b03-4c6a-9ef5-79fd4fcbe467 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:11.852585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdace1a-1b03-4c6a-9ef5-79fd4fcbe467 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:11.873723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:11.874749 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:11.875266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:11.875572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:11.876421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:11.876733 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:11.878413 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:11.881728 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:11.901868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1393/2766] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:11.903699 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b14fb1-30b0-4b48-949f-fbf7ea174e0f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:11.915301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b14fb1-30b0-4b48-949f-fbf7ea174e0f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:11.921050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:11.921743 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:11.922031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:11.923050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:11.923050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:11.925928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:11.985953 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1374/2767] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:11 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:10:11.991189 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:12.010605 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b55d7a-fda2-484b-8a1d-0e4bcd60884a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:12.141505 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:12.142243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:12.142534 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:12.142813 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:12.143528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:12.145603 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:12.188164 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1394/2768] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:11 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:12.192604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:12.206905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fb1ab-f9f6-4000-8d61-99e7c602c3dd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:12.212442 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:12.213366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:12.213774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:12.214172 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:12.214986 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:12.217989 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:12.243028 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1375/2769] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:12.243274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:12.255892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9ce8-3ed1-4c56-92b8-014ece0dd89b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:12.263323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dc939-774c-49a1-ab41-d31fdb493abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:12.265015 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dc939-774c-49a1-ab41-d31fdb493abe admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:12.265856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dc939-774c-49a1-ab41-d31fdb493abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:12.266214 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dc939-774c-49a1-ab41-d31fdb493abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:12.267327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dc939-774c-49a1-ab41-d31fdb493abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:12.268987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dc939-774c-49a1-ab41-d31fdb493abe admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:12.283154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1395/2770] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:12.287067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:12.301095 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be5350-5ce1-44b5-a1bf-d2c9e3d224b3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:12.308173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:12.310037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:12.310454 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:12.310964 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] PATH_INFO: `/v3/projects/c010794e91c848068cd7f4b1c8da1d22/users/6095a0c2f54a4e41b0ece43b7e358ad5/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:12.332382 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c010794e91c848068cd7f4b1c8da1d22, user_id=6095a0c2f54a4e41b0ece43b7e358ad5, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:12.335786 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:12.355424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1376/2771] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:12 2022] PUT /identity/v3/projects/c010794e91c848068cd7f4b1c8da1d22/users/6095a0c2f54a4e41b0ece43b7e358ad5/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:10:12.368139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9e66-81c1-4695-b297-3e7dc15bfd29 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:12.368387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9e66-81c1-4695-b297-3e7dc15bfd29 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:12.368629 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9e66-81c1-4695-b297-3e7dc15bfd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:12.407526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-521d9e66-81c1-4695-b297-3e7dc15bfd29 None None] MFA Rules not processed for user `6095a0c2f54a4e41b0ece43b7e358ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:12.409542 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-521d9e66-81c1-4695-b297-3e7dc15bfd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:12.526247 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1396/2772] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:12.531843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:12.547899 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:12.687531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711631f-b3da-4b39-be7e-5243534a8f5d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:12.694280 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:12.695897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:12.695897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:12.695897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:12.696819 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:12.699825 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:12.751979 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1377/2773] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:12 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:12.757678 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9e66-81c1-4695-b297-3e7dc15bfd29 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:12.773082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9e66-81c1-4695-b297-3e7dc15bfd29 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:12.948319 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:12.950955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:12.951511 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:12.952031 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:12.953566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:12.958109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:12.976697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:13.003237 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1397/2774] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:12 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:13.008728 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:13.023536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cfeb2-9355-4491-9f77-e3b480b150ff admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:13.030615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:13.031625 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:13.032191 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:13.032644 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:13.034576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:13.036751 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:13.070106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1378/2775] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:13.072659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:13.101538 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4f73-d1bc-4036-aee6-9f8fe712a429 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:13.131715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:13.132676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:13.132959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:13.133246 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] PATH_INFO: `/v3/projects/e2214da425e5405ab111809e92ac674d/users/25b4de4829014162ab7484113493c341/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:13.171242 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2214da425e5405ab111809e92ac674d, user_id=25b4de4829014162ab7484113493c341, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:13.175172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:13.209383 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1398/2776] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:13 2022] PUT /identity/v3/projects/e2214da425e5405ab111809e92ac674d/users/25b4de4829014162ab7484113493c341/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:13.215135 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:13.238416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7e5ac-93a8-46e2-b574-59aca547c1f1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:13.368375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c43a2-528f-4f5a-8268-115b6c871fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:13.369228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c43a2-528f-4f5a-8268-115b6c871fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:13.369322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c43a2-528f-4f5a-8268-115b6c871fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:13.369646 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c43a2-528f-4f5a-8268-115b6c871fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:13.370469 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c43a2-528f-4f5a-8268-115b6c871fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:13.372327 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c43a2-528f-4f5a-8268-115b6c871fa2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:13.388612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1379/2777] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:13.392936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:13.405233 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763b1d-9e7a-4bfc-9260-e33bf02931d7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:13.411378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:13.412435 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:13.412793 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:13.413139 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] PATH_INFO: `/v3/projects/e2214da425e5405ab111809e92ac674d/users/25b4de4829014162ab7484113493c341/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:13.415467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2214da425e5405ab111809e92ac674d, user_id=25b4de4829014162ab7484113493c341, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:13.418625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:13.433951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1399/2778] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:13 2022] PUT /identity/v3/projects/e2214da425e5405ab111809e92ac674d/users/25b4de4829014162ab7484113493c341/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:13.454528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc314c-405a-42b4-908f-530514c27034 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:13.455063 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc314c-405a-42b4-908f-530514c27034 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:13.455384 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc314c-405a-42b4-908f-530514c27034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:13.503688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e6dc314c-405a-42b4-908f-530514c27034 None None] MFA Rules not processed for user `25b4de4829014162ab7484113493c341`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:13.506329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e6dc314c-405a-42b4-908f-530514c27034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:13.601182 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1380/2779] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:13.624177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:13.628323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:13.740512 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a7313-4a2b-42c3-8620-ba9c0c502e63 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:13.744476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:13.745172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:13.745467 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:13.745789 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:13.758849 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:13.759941 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:13.798384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1400/2780] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:14.460329 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96656a-5fed-4e47-828b-42f78912eb05 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:14.461080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96656a-5fed-4e47-828b-42f78912eb05 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:14.461080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96656a-5fed-4e47-828b-42f78912eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:14.474721 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:14.505997 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3d96656a-5fed-4e47-828b-42f78912eb05 None None] MFA Rules not processed for user `e6d5c34aba8047e593b32ec34ab7fba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:14.507607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3d96656a-5fed-4e47-828b-42f78912eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:14.674897 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1381/2781] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:14.678528 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:14.679970 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:14.773034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c46e-1f2f-4df4-8361-f5f426153318 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:14.786719 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:14.787422 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:14.787714 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:14.787991 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:14.788741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:14.790664 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:14.837326 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1401/2782] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:14 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:10:14.841866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96656a-5fed-4e47-828b-42f78912eb05 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:14.854524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96656a-5fed-4e47-828b-42f78912eb05 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:14.951578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:14.952305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:14.952554 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:14.952874 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:14.953647 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:14.956885 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:14.986293 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1382/2783] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:14 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:10:14.990120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:15.003426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf716b3-b900-483c-b6c1-321ea3749d45 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:15.012766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:15.013845 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.014206 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.015724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.016637 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:15.018487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:15.031229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1402/2784] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:15.035620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:15.047281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff4faf-4718-4fad-ae3b-d6e6a35b3201 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:15.052378 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:15.053313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.053601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.053928 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] PATH_INFO: `/v3/projects/cc0892227f1d404184ae8e4bf3c2c9ce/users/1a818a25d7b04a7f8f63dd536141ffa9/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.078602 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0892227f1d404184ae8e4bf3c2c9ce, user_id=1a818a25d7b04a7f8f63dd536141ffa9, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:15.081607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:15.102623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1383/2785] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:15 2022] PUT /identity/v3/projects/cc0892227f1d404184ae8e4bf3c2c9ce/users/1a818a25d7b04a7f8f63dd536141ffa9/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:15.103791 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:15.115885 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0b2e6-4b59-4ece-8291-c8718697377c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:15.174149 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:15.219736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:15.221125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.221125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.221617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.222615 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:15.224760 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:15.243508 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1403/2786] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:15.244938 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:15.257774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d32b7-39fb-4e6e-842d-ba7a2227f32c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:15.265604 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:15.266623 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.268184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.268495 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] PATH_INFO: `/v3/projects/cc0892227f1d404184ae8e4bf3c2c9ce/users/1a818a25d7b04a7f8f63dd536141ffa9/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.271266 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0892227f1d404184ae8e4bf3c2c9ce, user_id=1a818a25d7b04a7f8f63dd536141ffa9, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:15.274045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:15.296033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1384/2787] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:15 2022] PUT /identity/v3/projects/cc0892227f1d404184ae8e4bf3c2c9ce/users/1a818a25d7b04a7f8f63dd536141ffa9/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:15.614082 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:15.618215 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:15.637368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f6a0b-8de3-49e6-8d57-26e7465c8933 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:15.821415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:15.829884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:15.831594 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.832994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.833617 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] PATH_INFO: `/v3/users/6f7b0be45f2c47abb00981002f68d5c2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.835324 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7b0be45f2c47abb00981002f68d5c2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:15.835747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff15b16-a975-49af-ba9f-903a46628d85 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:15.840239 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:15.843599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:15.848549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.849119 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.849552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] PATH_INFO: `/v3/users/6095a0c2f54a4e41b0ece43b7e358ad5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.851435 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6095a0c2f54a4e41b0ece43b7e358ad5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:15.854121 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:15.926318 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7b0be45f2c47abb00981002f68d5c2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.941564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:15.947804 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7b0be45f2c47abb00981002f68d5c2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.958936 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6095a0c2f54a4e41b0ece43b7e358ad5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.962024 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7b0be45f2c47abb00981002f68d5c2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.972493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6095a0c2f54a4e41b0ece43b7e358ad5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.973460 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6095a0c2f54a4e41b0ece43b7e358ad5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.974394 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6095a0c2f54a4e41b0ece43b7e358ad5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.976701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7b0be45f2c47abb00981002f68d5c2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.977310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae7b0f5-4a17-4d27-b04f-03ad7e7893cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7b0be45f2c47abb00981002f68d5c2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:15.986920 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1404/2788] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:15 2022] DELETE /identity/v3/users/6f7b0be45f2c47abb00981002f68d5c2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:15.993035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.993415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.993767 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.003462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-57d1125e-3752-4a27-8498-64d8ba262ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6095a0c2f54a4e41b0ece43b7e358ad5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:16.016681 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:16.018330 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:16.036094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1385/2789] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:15 2022] DELETE /identity/v3/users/6095a0c2f54a4e41b0ece43b7e358ad5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:16.041597 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:16.041831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:16.042357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.063919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:16.065246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:16.096731 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:16.128106 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1405/2790] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:16.138052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:16.140065 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:16.165311 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1386/2791] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:16.178091 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:16.179635 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:16.246390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa3ba9-aafa-4832-a03c-8356ded05801 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:16.290960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d163c4-eb4c-4bda-bd1b-4e0c7343b9e9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:16.297730 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:16.298335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:16.298826 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:16.300217 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.313315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:16.314845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:16.327549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1387/2792] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:16.346194 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d52ec-17c5-4b13-92f0-0c2018a8d8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:16.346811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d52ec-17c5-4b13-92f0-0c2018a8d8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:16.347107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d52ec-17c5-4b13-92f0-0c2018a8d8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:16.347390 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d52ec-17c5-4b13-92f0-0c2018a8d8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.360708 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d52ec-17c5-4b13-92f0-0c2018a8d8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:16.362471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d52ec-17c5-4b13-92f0-0c2018a8d8a7 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:16.376592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1406/2793] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:16.815326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:16.817045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:16.843747 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a9a3-8e60-4fd2-aa2d-77217da687dd service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:16.850724 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:16.851692 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:16.852254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:16.852601 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] PATH_INFO: `/v3/projects/0d34bc12495f4446a3be7b882aea1216` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.854019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d34bc12495f4446a3be7b882aea1216)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:16.860925 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:16.970050 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d34bc12495f4446a3be7b882aea1216', 'request_id': 'req-5afff069-b202-4867-b7ab-cefaa9352618'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:16.988221 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d34bc12495f4446a3be7b882aea1216', 'request_id': 'req-5afff069-b202-4867-b7ab-cefaa9352618'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:16.990120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:17.002801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d34bc12495f4446a3be7b882aea1216', 'request_id': 'req-5afff069-b202-4867-b7ab-cefaa9352618'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.037522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] The token cache is being invalidate because project 0d34bc12495f4446a3be7b882aea1216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:17.038228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.042498 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.045432 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1388/2794] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:16 2022] DELETE /identity/v3/projects/0d34bc12495f4446a3be7b882aea1216 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:17.051126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014caaca-2e13-493f-8a02-2779655a0a85 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.051976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014caaca-2e13-493f-8a02-2779655a0a85 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.051976 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014caaca-2e13-493f-8a02-2779655a0a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.106607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-014caaca-2e13-493f-8a02-2779655a0a85 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:17.111327 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-014caaca-2e13-493f-8a02-2779655a0a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:17.168704 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:17.170985 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:17.343278 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1407/2795] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:17.351301 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093426-c64c-4dcc-aa42-b590d7a87049 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.352536 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093426-c64c-4dcc-aa42-b590d7a87049 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.352835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093426-c64c-4dcc-aa42-b590d7a87049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.365024 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afff069-b202-4867-b7ab-cefaa9352618 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:17.374357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:17.376222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.376641 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.377023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] PATH_INFO: `/v3/projects/c010794e91c848068cd7f4b1c8da1d22` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.378878 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c010794e91c848068cd7f4b1c8da1d22)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:17.384084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:17.390790 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-04093426-c64c-4dcc-aa42-b590d7a87049 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:17.392570 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-04093426-c64c-4dcc-aa42-b590d7a87049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:17.402033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1408/2796] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:17.406881 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04093426-c64c-4dcc-aa42-b590d7a87049 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:17.418450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04093426-c64c-4dcc-aa42-b590d7a87049 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:17.430942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:17.431711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.432359 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.432655 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.433625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:17.433768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:17.436619 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:17.456943 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1409/2797] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:10:17.457944 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:17.472268 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c8e25-dffe-4ac9-967d-cf661d95fc2d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:17.507292 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c010794e91c848068cd7f4b1c8da1d22', 'request_id': 'req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.526916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c010794e91c848068cd7f4b1c8da1d22', 'request_id': 'req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.533957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:17.542534 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c010794e91c848068cd7f4b1c8da1d22', 'request_id': 'req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.557758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] The token cache is being invalidate because project c010794e91c848068cd7f4b1c8da1d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:17.558395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.559245 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.561832 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1389/2798] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:17 2022] DELETE /identity/v3/projects/c010794e91c848068cd7f4b1c8da1d22 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:17.567739 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:17.570888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:17.627179 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:17.627892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.630796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.631235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.632146 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:17.636556 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:17.710925 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1410/2799] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:17 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:17.714864 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:17.719378 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:17.748599 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c3e1a-f68d-44ca-8c40-fb024ea4ae7d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:17.783914 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:17.835408 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:17.837067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.837476 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.838396 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] PATH_INFO: `/v3/users/25b4de4829014162ab7484113493c341` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.839294 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b4de4829014162ab7484113493c341)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:17.840982 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babebfe-44ca-409b-be12-3c2db3e5600b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:17.841800 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:17.849457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:17.850763 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.852154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.852657 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.853569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:17.856497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:17.892060 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1411/2800] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:17 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:17.896526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:17.911772 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5740-fcd2-430f-93af-f4e19c41a5f5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:17.914456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b4de4829014162ab7484113493c341'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.920102 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:17.921393 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:17.922034 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:17.922640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:17.925638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:17.929506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b4de4829014162ab7484113493c341'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.930214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b4de4829014162ab7484113493c341'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.931368 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b4de4829014162ab7484113493c341'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.932850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:17.948882 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b4de4829014162ab7484113493c341'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:17.957872 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1412/2801] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:17.963384 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:17.966014 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:17.980866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1390/2802] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:17 2022] DELETE /identity/v3/users/25b4de4829014162ab7484113493c341 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:10:18.005012 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1ab95-3817-4665-83d4-30206c90c81b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:18.095209 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec763cfc-82f1-4935-a76e-dd64638ea3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:18.097823 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763cfc-82f1-4935-a76e-dd64638ea3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:18.098802 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763cfc-82f1-4935-a76e-dd64638ea3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:18.099307 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763cfc-82f1-4935-a76e-dd64638ea3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:18.101289 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec763cfc-82f1-4935-a76e-dd64638ea3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:18.103676 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec763cfc-82f1-4935-a76e-dd64638ea3d9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:18.122254 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1413/2803] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:18.127019 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:18.147857 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61799aa3-0a88-4a3a-a8e1-36dbc9439f9c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:18.159667 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:18.164681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:18.165907 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:18.166484 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] PATH_INFO: `/v3/projects/fe9ba94e613048a29863883b7ff78ed5/users/0b42da93a8624c5cbd3ed408e128f24a/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:18.201306 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9ba94e613048a29863883b7ff78ed5, user_id=0b42da93a8624c5cbd3ed408e128f24a, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:18.204300 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:18.229246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1391/2804] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:18 2022] PUT /identity/v3/projects/fe9ba94e613048a29863883b7ff78ed5/users/0b42da93a8624c5cbd3ed408e128f24a/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:18.243589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867f8af-0fe9-44a6-9350-2ae02dd4e447 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:18.244544 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867f8af-0fe9-44a6-9350-2ae02dd4e447 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:18.245448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867f8af-0fe9-44a6-9350-2ae02dd4e447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:18.317421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5867f8af-0fe9-44a6-9350-2ae02dd4e447 None None] MFA Rules not processed for user `0b42da93a8624c5cbd3ed408e128f24a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:18.319703 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5867f8af-0fe9-44a6-9350-2ae02dd4e447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:18.378520 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:18.502738 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1414/2805] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:18.508968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:18.681448 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcded8bf-8531-4df8-9842-26a2b63972f6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:18.692450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:18.694254 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:18.694846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:18.695305 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:18.696299 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:18.699470 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:18.752694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1392/2806] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:18 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:18.756988 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867f8af-0fe9-44a6-9350-2ae02dd4e447 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:18.782310 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867f8af-0fe9-44a6-9350-2ae02dd4e447 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:18.881978 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:18.882599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:18.883048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:18.884125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:18.888739 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:18.894964 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:18.972089 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1415/2807] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:18 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:10:18.976214 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:18.986831 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:19.001045 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0922e8-ca5f-45a7-9b84-93649c0ac6bb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.022589 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.023990 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.024531 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.025026 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.026500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.032886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.034285 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.037448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:19.082007 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b741f-8963-4999-837e-0dbf9e0d0476 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.085983 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1393/2808] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:19.088383 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.103195 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.104280 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.104592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.104874 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] PATH_INFO: `/v3/projects/e2214da425e5405ab111809e92ac674d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.107531 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2214da425e5405ab111809e92ac674d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.111756 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88acb7-f832-4668-96d7-15e638102ca6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.111959 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.124475 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.126113 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.127295 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.127913 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.129867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.133887 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.164734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1394/2809] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:19.167011 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.200607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b717-d7f3-4e64-8d4f-c0e7c0f5dd01 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.213016 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51228e3-5bb1-4072-ab2a-ad8ae85a44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.215206 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51228e3-5bb1-4072-ab2a-ad8ae85a44a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.215854 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51228e3-5bb1-4072-ab2a-ad8ae85a44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.216687 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51228e3-5bb1-4072-ab2a-ad8ae85a44a8 admin admin] PATH_INFO: `/v3/projects/48dd01be703443f2aed02e3b5d058cb9/users/cfc7ee21ec9e47ce9b8631f24a050ba6/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.267264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2214da425e5405ab111809e92ac674d', 'request_id': 'req-7657a71a-f1cf-4660-983e-5f535be5d301'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:19.285290 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51228e3-5bb1-4072-ab2a-ad8ae85a44a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dd01be703443f2aed02e3b5d058cb9, user_id=cfc7ee21ec9e47ce9b8631f24a050ba6, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.292541 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2214da425e5405ab111809e92ac674d', 'request_id': 'req-7657a71a-f1cf-4660-983e-5f535be5d301'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:19.293549 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51228e3-5bb1-4072-ab2a-ad8ae85a44a8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.308464 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2214da425e5405ab111809e92ac674d', 'request_id': 'req-7657a71a-f1cf-4660-983e-5f535be5d301'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:19.335829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] The token cache is being invalidate because project e2214da425e5405ab111809e92ac674d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:19.336159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:19.340084 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1395/2810] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:19 2022] PUT /identity/v3/projects/48dd01be703443f2aed02e3b5d058cb9/users/cfc7ee21ec9e47ce9b8631f24a050ba6/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:19.340299 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7657a71a-f1cf-4660-983e-5f535be5d301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:19.341496 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1416/2811] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:19 2022] DELETE /identity/v3/projects/e2214da425e5405ab111809e92ac674d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:10:19.350310 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480cb2a-9406-48b1-b531-ac19bc00b476 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.351612 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480cb2a-9406-48b1-b531-ac19bc00b476 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.352188 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480cb2a-9406-48b1-b531-ac19bc00b476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.359245 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.359751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.360321 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.410818 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0480cb2a-9406-48b1-b531-ac19bc00b476 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:19.412706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0480cb2a-9406-48b1-b531-ac19bc00b476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:19.441175 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] MFA Rules not processed for user `cfc7ee21ec9e47ce9b8631f24a050ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:19.445554 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:19.499437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:19.622478 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1417/2812] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:19.629886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.631415 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:19.651796 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1396/2813] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:19.666905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827f7b-1318-49c3-976a-28e99e1c35f0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.670738 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827f7b-1318-49c3-976a-28e99e1c35f0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.671236 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827f7b-1318-49c3-976a-28e99e1c35f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.724360 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c8827f7b-1318-49c3-976a-28e99e1c35f0 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:19.726994 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8827f7b-1318-49c3-976a-28e99e1c35f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:19.740771 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c50c-f30a-4494-93f5-2bcdcd3a93d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.742033 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1397/2814] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:19.746426 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.747437 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.747784 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.748639 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.749724 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.749848 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827f7b-1318-49c3-976a-28e99e1c35f0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.751747 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.764821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827f7b-1318-49c3-976a-28e99e1c35f0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.775023 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.776197 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.776695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.777186 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.778550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:19.780283 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.783514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.808966 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1418/2815] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:19 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:10:19.813715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.815861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1398/2816] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:19.817702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.839886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204c4ab-cc3b-4846-a44a-ec6e7dccd73a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.944228 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.945561 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.946062 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.946520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.948431 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.951705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.984503 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ca52c-8df1-406d-9633-9310b72a7ed5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.011504 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.012659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.013891 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.014360 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.015313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1399/2817] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:19 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:20.021346 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.021582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.024723 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.076006 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1419/2818] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:19 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:10:20.078687 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.083321 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:20.118406 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a1fa-d591-4ad6-9739-910680882981 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.140282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec15c-5c9c-4c8d-8348-285190ecc4bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.147346 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.148132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.148430 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.148867 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.149802 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.152421 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.190618 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1400/2819] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:20 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:10:20.195966 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.198308 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:20.220690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146c0d-94ca-481d-b4d3-3d4d0d6285a6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.239723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.240520 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.240815 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.241100 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.241861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.243524 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.263883 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.264800 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.265187 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.265675 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.266535 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.267380 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1401/2820] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:20.273418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.276085 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.296697 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1420/2821] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:20.296944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34647-539c-4a1f-9132-99ed9780bd9e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.300140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.305695 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.306961 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.307429 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.308578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.309755 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.314268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.322453 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df578-3ae6-4783-94b8-8d75cacbf112 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.336918 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1402/2822] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:20.341582 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.348853 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.349787 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.350084 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.350371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] PATH_INFO: `/v3/projects/f44d24a7c22c44f6ad2e14bc223ec483/users/ee1a078a587c465a82a1052acfc48418/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.355617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865cbaa-3c9b-406e-be7d-6dc1ce869df6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.366320 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e6a8f-e27d-4489-8ae0-cf498a31a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.368314 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e6a8f-e27d-4489-8ae0-cf498a31a1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.368894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e6a8f-e27d-4489-8ae0-cf498a31a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.369550 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e6a8f-e27d-4489-8ae0-cf498a31a1d2 admin admin] PATH_INFO: `/v3/projects/e0d5c9174c584f259c661ddae02e9c84/users/6df67dcb97d44f9a813d982554ad7cb3/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.407365 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44d24a7c22c44f6ad2e14bc223ec483, user_id=ee1a078a587c465a82a1052acfc48418, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.410620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.420139 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e6a8f-e27d-4489-8ae0-cf498a31a1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d5c9174c584f259c661ddae02e9c84, user_id=6df67dcb97d44f9a813d982554ad7cb3, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.428927 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e6a8f-e27d-4489-8ae0-cf498a31a1d2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.437898 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1421/2823] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:20 2022] PUT /identity/v3/projects/f44d24a7c22c44f6ad2e14bc223ec483/users/ee1a078a587c465a82a1052acfc48418/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:20.445211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.478282 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1403/2824] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:20 2022] PUT /identity/v3/projects/e0d5c9174c584f259c661ddae02e9c84/users/6df67dcb97d44f9a813d982554ad7cb3/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:20.479905 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.483242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.483864 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.520571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:20.522505 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:20.610368 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1404/2825] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:20.621514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.626530 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:20.630879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d16d6-bd58-454a-a333-e464241a1760 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.644926 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.645634 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.645930 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.646227 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.646980 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.648684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.661625 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1422/2826] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:20.666945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:20.682778 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293587-8eb6-4e81-8050-96eb264981bb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.690410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426302a-b7ca-4665-b1ce-fa6350259cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.691521 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426302a-b7ca-4665-b1ce-fa6350259cba admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.691890 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426302a-b7ca-4665-b1ce-fa6350259cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.692279 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426302a-b7ca-4665-b1ce-fa6350259cba admin admin] PATH_INFO: `/v3/projects/f44d24a7c22c44f6ad2e14bc223ec483/users/ee1a078a587c465a82a1052acfc48418/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.695017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426302a-b7ca-4665-b1ce-fa6350259cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44d24a7c22c44f6ad2e14bc223ec483, user_id=ee1a078a587c465a82a1052acfc48418, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:20.698126 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426302a-b7ca-4665-b1ce-fa6350259cba admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:20.719477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1423/2827] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:20 2022] PUT /identity/v3/projects/f44d24a7c22c44f6ad2e14bc223ec483/users/ee1a078a587c465a82a1052acfc48418/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:20.725617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6b898-2d22-4c0c-9fab-b7b1ad2aeec7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:20.739936 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.740288 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.741152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:20.780843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:20.818525 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] MFA Rules not processed for user `ee1a078a587c465a82a1052acfc48418`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:20.820633 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:20.846226 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7b505-b2f3-4c09-a08a-74fe0300efbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:20.846891 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b505-b2f3-4c09-a08a-74fe0300efbf service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:20.847184 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b505-b2f3-4c09-a08a-74fe0300efbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:20.847464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b505-b2f3-4c09-a08a-74fe0300efbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:21.009258 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1424/2828] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:21.016316 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7b505-b2f3-4c09-a08a-74fe0300efbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:21.018490 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7b505-b2f3-4c09-a08a-74fe0300efbf service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:21.025368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:21.027154 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:21.034965 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1405/2829] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:21.088638 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:21.193856 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488a4e-0f48-41ab-9183-fdd64700fd40 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:21.204460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:21.205768 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:21.206177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:21.206761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:21.210927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:21.379098 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:21.381416 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:21.397050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1425/2830] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:22.338689 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2abc-1f89-421f-b54b-241ff3a3a98f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:22.339240 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2abc-1f89-421f-b54b-241ff3a3a98f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:22.339482 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e2abc-1f89-421f-b54b-241ff3a3a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:22.384657 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b14e2abc-1f89-421f-b54b-241ff3a3a98f None None] MFA Rules not processed for user `6df67dcb97d44f9a813d982554ad7cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:22.386176 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b14e2abc-1f89-421f-b54b-241ff3a3a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:22.535579 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1406/2831] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:22.536620 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:22.553585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:22.553585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:22.553585 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:22.554035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719e8a2-0cf7-4f03-a638-3ea79a4a54e1 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:22.558852 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:22.559537 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:22.559831 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:22.560495 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:22.561235 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:22.564757 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:22.591537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] MFA Rules not processed for user `1a818a25d7b04a7f8f63dd536141ffa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:22.593622 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:22.604058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1426/2832] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:22 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:22.608695 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:22.666702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:22.705088 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1407/2833] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:22.722592 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:22.723987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:22.738945 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011e61a-9f54-46f8-a943-451cf7f8329b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:22.746003 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:22.747357 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:22.752666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:22.752666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:22.752666 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:22.754915 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:22.792216 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1427/2834] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:22 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:22.797011 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:22.808159 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7e02-b5a8-4484-8ac1-ea97790a2d8a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:22.808613 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c72d3f-74d5-4e15-b0ca-774bec906d01 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:22.813832 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:22.814663 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:22.814957 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:22.815243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:22.816265 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:22.817934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:22.835901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1428/2835] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:22.836715 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:22.876131 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd425-af94-4bf0-a557-bfd1c7f66425 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:22.895577 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:22.897595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:22.898796 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:22.899136 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] PATH_INFO: `/v3/projects/2d08b8cf7f9045b2a0ba499d654b0c1a/users/c589b7ed6e0648a5b7790cc168c69a23/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:22.929033 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d08b8cf7f9045b2a0ba499d654b0c1a, user_id=c589b7ed6e0648a5b7790cc168c69a23, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:22.933208 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:22.945824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:22.946615 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:22.947141 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:22.947855 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:22.949906 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:22.964295 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1429/2836] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:22 2022] PUT /identity/v3/projects/2d08b8cf7f9045b2a0ba499d654b0c1a/users/c589b7ed6e0648a5b7790cc168c69a23/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:10:22.965673 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:22.984648 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:23.034752 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:23.036425 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:23.069978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1408/2837] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:23.088196 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0d4d-77e5-4627-9c65-e3dee693ce2c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:23.095679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:23.096420 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:23.096934 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:23.097230 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:23.097994 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:23.099913 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:23.123000 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1430/2838] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:23.124205 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:23.138822 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9090f6d-feaa-4340-957d-06e0b52e4aa8 service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:23.141016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:23.142975 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:23.160552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cc5a6-e814-4c5d-aa9c-1c7c16b7ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:23.161637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc5a6-e814-4c5d-aa9c-1c7c16b7ced0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:23.161933 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc5a6-e814-4c5d-aa9c-1c7c16b7ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:23.162223 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc5a6-e814-4c5d-aa9c-1c7c16b7ced0 admin admin] PATH_INFO: `/v3/projects/2d08b8cf7f9045b2a0ba499d654b0c1a/users/c589b7ed6e0648a5b7790cc168c69a23/roles/cde11b02d419404ea30981d75030a0a8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:23.165591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cc5a6-e814-4c5d-aa9c-1c7c16b7ced0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d08b8cf7f9045b2a0ba499d654b0c1a, user_id=c589b7ed6e0648a5b7790cc168c69a23, role_id=cde11b02d419404ea30981d75030a0a8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:23.174780 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cc5a6-e814-4c5d-aa9c-1c7c16b7ced0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:23.204389 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1409/2839] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:23 2022] PUT /identity/v3/projects/2d08b8cf7f9045b2a0ba499d654b0c1a/users/c589b7ed6e0648a5b7790cc168c69a23/roles/cde11b02d419404ea30981d75030a0a8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:23.233955 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b31029-0b4e-4f61-94f4-251330618869 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:23.263089 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:23.263528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:23.264426 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:23.291117 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:23.292714 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:23.313300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93450f-194c-4abd-928e-94de40032966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:23.314177 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93450f-194c-4abd-928e-94de40032966 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:23.314907 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93450f-194c-4abd-928e-94de40032966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:23.315205 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93450f-194c-4abd-928e-94de40032966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:23.359379 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:23.385500 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1410/2840] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:10:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:23.393835 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:23.397353 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:23.419052 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93450f-194c-4abd-928e-94de40032966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:23.421243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93450f-194c-4abd-928e-94de40032966 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:23.436459 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1431/2841] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:23.593571 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251f632-c50c-4fff-b02f-43c7399b81e0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:23.610215 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:23.611792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:23.612584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:23.613083 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:23.642600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:23.647148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:23.667552 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1411/2842] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:10:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:10:24.715056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3616-d017-4a2a-8d7e-21c07074c1cf None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:24.715569 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3616-d017-4a2a-8d7e-21c07074c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:24.715683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3616-d017-4a2a-8d7e-21c07074c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:24.735013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:24.746175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4fa3f-4c08-4e41-bd66-bbcac65f6147 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:24.754425 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:24.779258 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:24.780669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:24.781067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:24.781425 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:24.795044 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a81a3616-d017-4a2a-8d7e-21c07074c1cf None None] MFA Rules not processed for user `c589b7ed6e0648a5b7790cc168c69a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:24.797371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a81a3616-d017-4a2a-8d7e-21c07074c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:24.903670 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:24.907945 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:24.931445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1432/2843] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:24.943871 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1412/2844] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:10:24.957699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3616-d017-4a2a-8d7e-21c07074c1cf None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:24.970116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3616-d017-4a2a-8d7e-21c07074c1cf None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:24.979742 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:24.980860 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:24.981379 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:24.981868 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:25.141509 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:25.142983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:25.157112 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1433/2845] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:26.903246 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:26.925351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1f502-4dc9-4e29-b9e8-1413c5991d40 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:26.930070 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e1d67-0625-4a7b-b981-c56fa170d5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:26.930968 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1d67-0625-4a7b-b981-c56fa170d5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:26.931285 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1d67-0625-4a7b-b981-c56fa170d5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:26.931617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1d67-0625-4a7b-b981-c56fa170d5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:26.946852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e1d67-0625-4a7b-b981-c56fa170d5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:26.948336 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e1d67-0625-4a7b-b981-c56fa170d5f4 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:26.962782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1413/2846] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:29.386410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:29.541732 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31834520-0704-4e63-b23f-5c052b766480 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:29.559109 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:29.560826 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:29.561901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:29.562438 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] PATH_INFO: `/v3/users/0b42da93a8624c5cbd3ed408e128f24a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:29.566335 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b42da93a8624c5cbd3ed408e128f24a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:29.570766 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:29.670027 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:29.735380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b42da93a8624c5cbd3ed408e128f24a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:29.763198 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b42da93a8624c5cbd3ed408e128f24a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:29.777527 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b42da93a8624c5cbd3ed408e128f24a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:29.792066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b42da93a8624c5cbd3ed408e128f24a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:29.793480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b42da93a8624c5cbd3ed408e128f24a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:29.805048 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1434/2847] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:29 2022] DELETE /identity/v3/users/0b42da93a8624c5cbd3ed408e128f24a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:29.810427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:29.812211 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:29.812886 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:29.836762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:29.838433 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:29.952560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:29.967719 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1414/2848] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:29.976355 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:29.979116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:30.071894 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bafb19-762b-4967-b033-f7cee9cd1528 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:30.076526 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:30.078225 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:30.078516 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:30.078814 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:30.093737 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:30.095481 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:30.108439 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1435/2849] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:30.532111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:30.534348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:30.564999 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432f47-1ff6-48d8-85dc-1134778e34a6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:30.578963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:30.581669 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:30.582863 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:30.583366 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] PATH_INFO: `/v3/projects/fe9ba94e613048a29863883b7ff78ed5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:30.588655 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9ba94e613048a29863883b7ff78ed5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:30.595037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:30.731481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9ba94e613048a29863883b7ff78ed5', 'request_id': 'req-ee78498e-3df2-4e91-b5ef-eee0a811110d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:30.752123 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9ba94e613048a29863883b7ff78ed5', 'request_id': 'req-ee78498e-3df2-4e91-b5ef-eee0a811110d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:30.769594 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9ba94e613048a29863883b7ff78ed5', 'request_id': 'req-ee78498e-3df2-4e91-b5ef-eee0a811110d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:30.795637 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] The token cache is being invalidate because project fe9ba94e613048a29863883b7ff78ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:30.795971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:30.796783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:30.798450 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1415/2850] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:30 2022] DELETE /identity/v3/projects/fe9ba94e613048a29863883b7ff78ed5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:30.806058 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:30.815300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdfde1-1546-4f4a-832a-c71fa64f0ec4 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:30.904232 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:30.905252 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:30.905532 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:30.905886 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] PATH_INFO: `/v3/users/cfc7ee21ec9e47ce9b8631f24a050ba6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:30.908127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc7ee21ec9e47ce9b8631f24a050ba6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:30.910418 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:30.978807 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc7ee21ec9e47ce9b8631f24a050ba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:30.990349 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:30.999893 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc7ee21ec9e47ce9b8631f24a050ba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:31.011458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc7ee21ec9e47ce9b8631f24a050ba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:31.022070 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc7ee21ec9e47ce9b8631f24a050ba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:31.022829 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc7ee21ec9e47ce9b8631f24a050ba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:31.036972 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1436/2851] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:30 2022] DELETE /identity/v3/users/cfc7ee21ec9e47ce9b8631f24a050ba6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:31.638673 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:31.641060 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:31.665694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78498e-3df2-4e91-b5ef-eee0a811110d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:31.850754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:31.852859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:31.857566 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:31.858001 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] PATH_INFO: `/v3/projects/48dd01be703443f2aed02e3b5d058cb9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:31.859639 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dd01be703443f2aed02e3b5d058cb9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:31.864537 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:31.992849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dd01be703443f2aed02e3b5d058cb9', 'request_id': 'req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.006522 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dd01be703443f2aed02e3b5d058cb9', 'request_id': 'req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.015934 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dd01be703443f2aed02e3b5d058cb9', 'request_id': 'req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.036845 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] The token cache is being invalidate because project 48dd01be703443f2aed02e3b5d058cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:32.037148 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.037846 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.039932 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1416/2852] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:31 2022] DELETE /identity/v3/projects/48dd01be703443f2aed02e3b5d058cb9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:32.043775 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:32.046884 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:32.064008 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ef74c-fba7-4fa5-8c5e-181e03818d54 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:32.222665 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:32.223623 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:32.224062 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:32.224244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] PATH_INFO: `/v3/users/ee1a078a587c465a82a1052acfc48418` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:32.225987 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1a078a587c465a82a1052acfc48418)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:32.227984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:32.371788 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1a078a587c465a82a1052acfc48418'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.396632 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1a078a587c465a82a1052acfc48418'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.411313 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1a078a587c465a82a1052acfc48418'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.427125 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1a078a587c465a82a1052acfc48418'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.429259 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8315d6b6-38b7-46fc-af49-683e4b35be1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1a078a587c465a82a1052acfc48418'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:32.442477 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1437/2853] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:32 2022] DELETE /identity/v3/users/ee1a078a587c465a82a1052acfc48418 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:32.847686 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:32.850281 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:32.884935 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2a57e-d8ca-43cd-976f-2c4cf3da711f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:32.908813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:32.994467 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:32.995506 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:32.995792 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:32.996196 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] PATH_INFO: `/v3/projects/f44d24a7c22c44f6ad2e14bc223ec483` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:32.997456 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44d24a7c22c44f6ad2e14bc223ec483)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.000338 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.089781 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44d24a7c22c44f6ad2e14bc223ec483', 'request_id': 'req-fab5079d-bc3d-459b-b9f0-05c62cd3424b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:33.107859 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44d24a7c22c44f6ad2e14bc223ec483', 'request_id': 'req-fab5079d-bc3d-459b-b9f0-05c62cd3424b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:33.122514 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44d24a7c22c44f6ad2e14bc223ec483', 'request_id': 'req-fab5079d-bc3d-459b-b9f0-05c62cd3424b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:33.139296 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] The token cache is being invalidate because project f44d24a7c22c44f6ad2e14bc223ec483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:33.141493 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:33.143005 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fab5079d-bc3d-459b-b9f0-05c62cd3424b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:33.147349 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1417/2854] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:32 2022] DELETE /identity/v3/projects/f44d24a7c22c44f6ad2e14bc223ec483 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:10:33.154323 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76068879-bab2-426e-8329-d44202c32f93 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.154951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76068879-bab2-426e-8329-d44202c32f93 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.154951 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76068879-bab2-426e-8329-d44202c32f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.176249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-76068879-bab2-426e-8329-d44202c32f93 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:33.177817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-76068879-bab2-426e-8329-d44202c32f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:33.270257 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:33.289684 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1438/2855] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:33.363813 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d8fd-7959-474d-811f-70c284de3290 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.364357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d8fd-7959-474d-811f-70c284de3290 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.364576 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d8fd-7959-474d-811f-70c284de3290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.384734 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dc89d8fd-7959-474d-811f-70c284de3290 None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:33.386108 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dc89d8fd-7959-474d-811f-70c284de3290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:33.400838 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1418/2856] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:33.402946 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76068879-bab2-426e-8329-d44202c32f93 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:33.417152 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76068879-bab2-426e-8329-d44202c32f93 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:33.442370 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:33.443609 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.443901 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.444300 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.445338 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:33.445659 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.447375 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.470211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1439/2857] 10.222.0.69 () {58 vars in 1152 bytes} [Thu May 26 18:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:33.475548 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89d8fd-7959-474d-811f-70c284de3290 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:33.496991 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89d8fd-7959-474d-811f-70c284de3290 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:33.506510 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:33.507680 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.508242 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.508765 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.510138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.514348 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.570976 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1419/2858] 10.222.0.69 () {60 vars in 1152 bytes} [Thu May 26 18:10:33 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:33.581476 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:33.594081 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeec68-cbf3-434e-8580-f1e84615e843 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:33.708337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:33.709050 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.709337 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.709640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.710373 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.712810 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.740249 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1440/2859] 10.222.0.69 () {60 vars in 1143 bytes} [Thu May 26 18:10:33 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:10:33.746036 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:33.764138 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a60da-8840-4af0-922a-cd4c43a76a95 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:33.772416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:33.773690 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.774017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.774304 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.775106 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.776963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.792081 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1420/2860] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:33.798016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:33.811701 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e585-1d7c-4014-b01b-2390a31fcc03 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:33.819043 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9363d29-51f4-40a0-bf98-b0e1e0877c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:33.819908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9363d29-51f4-40a0-bf98-b0e1e0877c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.820314 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9363d29-51f4-40a0-bf98-b0e1e0877c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.820661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9363d29-51f4-40a0-bf98-b0e1e0877c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.821488 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9363d29-51f4-40a0-bf98-b0e1e0877c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.823583 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9363d29-51f4-40a0-bf98-b0e1e0877c7d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.837855 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1441/2861] 10.222.0.69 () {58 vars in 1121 bytes} [Thu May 26 18:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:10:33.841960 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:33.854427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad77a-0add-468f-9d59-83d6a43a97f6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:33.861111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:33.862192 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.862727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.863013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] PATH_INFO: `/v3/projects/19d2e2dfacde4e829dc363e186d20d62/users/6aee430249194b058313f7ba86b50e46/roles/2e54f04264af40db9d9999111f07233f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.893151 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d2e2dfacde4e829dc363e186d20d62, user_id=6aee430249194b058313f7ba86b50e46, role_id=2e54f04264af40db9d9999111f07233f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.904446 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.929017 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1421/2862] 10.222.0.69 () {60 vars in 1482 bytes} [Thu May 26 18:10:33 2022] PUT /identity/v3/projects/19d2e2dfacde4e829dc363e186d20d62/users/6aee430249194b058313f7ba86b50e46/roles/2e54f04264af40db9d9999111f07233f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:33.941836 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f5df-67b3-4a33-8e58-e60d32587819 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.942140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f5df-67b3-4a33-8e58-e60d32587819 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.942472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f5df-67b3-4a33-8e58-e60d32587819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.974918 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e726f5df-67b3-4a33-8e58-e60d32587819 None None] MFA Rules not processed for user `6aee430249194b058313f7ba86b50e46`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:33.976450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e726f5df-67b3-4a33-8e58-e60d32587819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:34.065567 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1442/2863] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:10:34.080998 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:34.082824 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:34.167931 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:34.196904 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff6ef8-2916-4cd0-b6b6-6842a31f047f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:34.205489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8a352-c2ff-4192-8b2c-99e213fb99aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ef983c46894dc6bff7fff34cc4e50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:34.205489 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a352-c2ff-4192-8b2c-99e213fb99aa service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:34.206111 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a352-c2ff-4192-8b2c-99e213fb99aa service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:34.206783 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a352-c2ff-4192-8b2c-99e213fb99aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:34.225660 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8a352-c2ff-4192-8b2c-99e213fb99aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:34.227358 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8a352-c2ff-4192-8b2c-99e213fb99aa service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:34.245399 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1422/2864] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:10:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:36.013296 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:36.013876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:36.013986 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:36.038818 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] MFA Rules not processed for user `e6d5c34aba8047e593b32ec34ab7fba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:36.039745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:36.106140 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:36.119707 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1443/2865] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:10:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:38.160607 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:38.161160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:38.161160 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:38.182315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:38.184129 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:38.272916 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1423/2866] 10.222.0.69 () {58 vars in 1009 bytes} [Thu May 26 18:10:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:38.285906 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:38.287745 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:38.377380 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93866574-d71b-4db5-9cab-3aaf2293a5cf None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:38.382712 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:38.383387 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:38.383679 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:38.384120 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:38.394861 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:38.396549 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:38.405361 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1444/2867] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:10:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:10:43.266387 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:43.268229 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:43.431076 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02280-a52a-43e5-93bc-e787a8715a71 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:43.436526 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:43.437540 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:43.438315 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:43.440248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] PATH_INFO: `/v3/users/6df67dcb97d44f9a813d982554ad7cb3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:43.441821 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df67dcb97d44f9a813d982554ad7cb3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:43.446364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:43.563308 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df67dcb97d44f9a813d982554ad7cb3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:43.574584 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df67dcb97d44f9a813d982554ad7cb3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:43.575600 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df67dcb97d44f9a813d982554ad7cb3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:43.576955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df67dcb97d44f9a813d982554ad7cb3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:43.603851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df67dcb97d44f9a813d982554ad7cb3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:43.638844 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1424/2868] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:43 2022] DELETE /identity/v3/users/6df67dcb97d44f9a813d982554ad7cb3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:43.929428 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:43.941914 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a242f-259e-4be9-8b2c-8d651b4edf3f service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:44.056421 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:44.057419 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:44.057811 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:44.058264 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] PATH_INFO: `/v3/projects/e0d5c9174c584f259c661ddae02e9c84` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:44.059606 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d5c9174c584f259c661ddae02e9c84)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:44.061680 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:44.132720 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d5c9174c584f259c661ddae02e9c84', 'request_id': 'req-d957c309-5d73-4957-be8d-cfd4b328b602'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.143119 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d5c9174c584f259c661ddae02e9c84', 'request_id': 'req-d957c309-5d73-4957-be8d-cfd4b328b602'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.160711 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d5c9174c584f259c661ddae02e9c84', 'request_id': 'req-d957c309-5d73-4957-be8d-cfd4b328b602'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.174297 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] The token cache is being invalidate because project e0d5c9174c584f259c661ddae02e9c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:44.174805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.175243 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.176929 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1445/2869] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:43 2022] DELETE /identity/v3/projects/e0d5c9174c584f259c661ddae02e9c84 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:44.181248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:44.183235 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:44.216749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c6d8-e5b0-4caf-8e04-650f22a1b780 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:44.222397 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:44.326671 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:44.327754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:44.328067 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:44.328417 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] PATH_INFO: `/v3/users/c589b7ed6e0648a5b7790cc168c69a23` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:44.329901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c589b7ed6e0648a5b7790cc168c69a23)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:44.331861 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:44.396572 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c589b7ed6e0648a5b7790cc168c69a23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.408944 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c589b7ed6e0648a5b7790cc168c69a23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.409744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c589b7ed6e0648a5b7790cc168c69a23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.410364 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c589b7ed6e0648a5b7790cc168c69a23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.425342 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c589b7ed6e0648a5b7790cc168c69a23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:44.439851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1425/2870] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:10:44 2022] DELETE /identity/v3/users/c589b7ed6e0648a5b7790cc168c69a23 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:44.849236 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:44.850838 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:44.866408 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957c309-5d73-4957-be8d-cfd4b328b602 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:44.917539 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:44.999935 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:45.001582 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:45.001781 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:45.001954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] PATH_INFO: `/v3/projects/2d08b8cf7f9045b2a0ba499d654b0c1a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:45.003218 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d08b8cf7f9045b2a0ba499d654b0c1a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:45.005266 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:45.071590 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d08b8cf7f9045b2a0ba499d654b0c1a', 'request_id': 'req-0cff3175-f461-4dec-9246-d7c12093e574'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:45.085207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d08b8cf7f9045b2a0ba499d654b0c1a', 'request_id': 'req-0cff3175-f461-4dec-9246-d7c12093e574'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:45.095138 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d08b8cf7f9045b2a0ba499d654b0c1a', 'request_id': 'req-0cff3175-f461-4dec-9246-d7c12093e574'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:45.108080 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] The token cache is being invalidate because project 2d08b8cf7f9045b2a0ba499d654b0c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:10:45.108458 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:45.109282 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0cff3175-f461-4dec-9246-d7c12093e574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:10:45.111518 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1446/2871] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:10:44 2022] DELETE /identity/v3/projects/2d08b8cf7f9045b2a0ba499d654b0c1a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:54.435479 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:55.104589 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:00.837271 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:00.838797 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:00.852638 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190940-48fd-45a2-96e3-c580a041593c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:00.913443 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:00.914357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:00.914642 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:00.914923 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] PATH_INFO: `/v3/users/6aee430249194b058313f7ba86b50e46` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:00.916200 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aee430249194b058313f7ba86b50e46)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:00.918248 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:00.981416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aee430249194b058313f7ba86b50e46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:00.990374 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aee430249194b058313f7ba86b50e46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:00.991424 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aee430249194b058313f7ba86b50e46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:00.992373 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aee430249194b058313f7ba86b50e46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:01.005052 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aee430249194b058313f7ba86b50e46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:01.018257 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1426/2872] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:11:00 2022] DELETE /identity/v3/users/6aee430249194b058313f7ba86b50e46 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:11:01.023445 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:01.023981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:01.023981 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:01.042595 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] MFA Rules not processed for user `c2a69d3812404e20840e7bb0da9d4d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:01.043799 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:01.104954 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1447/2873] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:11:01.114606 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:01.116335 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:01.174031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a34d5-f1b3-417b-a939-41c6b60d5d3f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:01.177744 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:01.178402 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:01.178688 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:01.178962 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:01.188376 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:01.190351 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:01.200154 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1427/2874] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:11:01.489792 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:01.491513 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:01.505765 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae68f4-ea57-47d7-a1f6-4a12118617eb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:01.510492 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:01.511371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:01.511658 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:01.511942 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] PATH_INFO: `/v3/projects/19d2e2dfacde4e829dc363e186d20d62` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:01.513220 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d2e2dfacde4e829dc363e186d20d62)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:01.515168 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:01.578057 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d2e2dfacde4e829dc363e186d20d62', 'request_id': 'req-e4974ec6-2445-42ea-84d3-037266c95012'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:01.584993 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d2e2dfacde4e829dc363e186d20d62', 'request_id': 'req-e4974ec6-2445-42ea-84d3-037266c95012'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:01.593984 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d2e2dfacde4e829dc363e186d20d62', 'request_id': 'req-e4974ec6-2445-42ea-84d3-037266c95012'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:01.605348 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] The token cache is being invalidate because project 19d2e2dfacde4e829dc363e186d20d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:11:01.605644 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:01.606293 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:11:01.607880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1448/2875] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:11:01 2022] DELETE /identity/v3/projects/19d2e2dfacde4e829dc363e186d20d62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:11:06.377851 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:06.386980 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbc5a3-ed78-40d5-ad96-2624e5606644 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:06.410682 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:06.419661 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:06.422448 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:06.459462 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0527bb3-f26f-4587-b0fd-8377daf3d201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:06.460169 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0527bb3-f26f-4587-b0fd-8377daf3d201 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:06.460511 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0527bb3-f26f-4587-b0fd-8377daf3d201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:06.460789 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0527bb3-f26f-4587-b0fd-8377daf3d201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:06.462705 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0527bb3-f26f-4587-b0fd-8377daf3d201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:06.508656 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974ec6-2445-42ea-84d3-037266c95012 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:06.515368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8e2195d53743f78c58cebdcd850fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:06.515368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:06.515368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:06.515368 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:06.518450 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:06.553536 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0527bb3-f26f-4587-b0fd-8377daf3d201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:06.556268 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0527bb3-f26f-4587-b0fd-8377daf3d201 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:06.570996 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1428/2876] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:11:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:11:06.574741 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:06.602309 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:06.604705 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:06.622274 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1449/2877] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:11:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:11:13.841464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:13.842031 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:13.842145 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:13.861104 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] MFA Rules not processed for user `9683ec43ae844757883a7dd5003b53d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:13.863516 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:13.870784 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1429/2878] 10.222.0.69 () {58 vars in 957 bytes} [Thu May 26 18:11:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:11:14.695592 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:14.697096 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:14.710211 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510b0b-f195-4a99-8cc0-aa8ea043edb5 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:14.713908 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:14.716009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.716009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.716009 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:14.717401 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:14.832427 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:14.834056 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:14.849487 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1450/2879] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:11:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:11:15.973901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:15.975702 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:15.990849 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b8066-f84f-4090-b787-0864fd2c35ac None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:15.994852 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:15.995727 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:15.996080 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:15.996427 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:15.998666 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:16.015477 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:16.017143 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:16.030679 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1430/2880] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:11:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:11:24.844203 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=44 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:26.025288 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=49 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:28.419354 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:28.428952 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053f6d-b13e-4579-968e-19c06badc0d7 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:28.432977 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:28.433546 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:28.433879 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:28.434172 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:28.435989 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:28.503750 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:28.505880 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:28.516238 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1451/2881] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:11:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:11:30.520762 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:30.530912 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464103-07aa-4042-b4eb-fb2a11ef57be service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:30.533901 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0e57d-7066-47d1-9349-90adb95342da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:30.534564 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0e57d-7066-47d1-9349-90adb95342da service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:30.534929 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0e57d-7066-47d1-9349-90adb95342da service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:30.535828 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0e57d-7066-47d1-9349-90adb95342da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:30.537978 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ef0e57d-7066-47d1-9349-90adb95342da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:30.548491 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0e57d-7066-47d1-9349-90adb95342da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:30.549963 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0e57d-7066-47d1-9349-90adb95342da service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:30.559949 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1431/2882] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:11:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:11:38.511270 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=30 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:40.555508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:25.809202 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:25.815345 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:25.880141 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72f4f-d97d-4a9b-a0bb-1329a2c17912 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:25.891471 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:25.892850 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.893649 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.894271 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.898575 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:25.927371 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:25.931042 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:25.966472 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1452/2883] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:12:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:33.665581 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:33.666173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:33.666173 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:33.690132 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] MFA Rules not processed for user `5927394f6adf4fd0b85d6cdeeec358b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:33.691377 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:33.771955 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1432/2884] 10.222.0.69 () {58 vars in 967 bytes} [Thu May 26 18:12:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:33.823350 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:33.825017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:33.904896 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743c45-8fc5-459c-befb-0a6bce61852e service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:33.910107 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7da9d33b941dc91a98c8adbb545d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:33.910783 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:33.911061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:33.911340 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:33.921001 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:33.922598 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:33.932269 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1453/2885] 10.222.0.69 () {60 vars in 1384 bytes} [Thu May 26 18:12:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:12:41.515937 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:41.517590 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:41.606833 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf718-e4af-4b4e-866a-67f798eaeeec None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:41.611415 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:41.612334 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:41.612616 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:41.612888 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] PATH_INFO: `/v3/users/e6d5c34aba8047e593b32ec34ab7fba9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:41.614120 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d5c34aba8047e593b32ec34ab7fba9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:41.616112 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:41.669830 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d5c34aba8047e593b32ec34ab7fba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:41.677094 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d5c34aba8047e593b32ec34ab7fba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:41.677774 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d5c34aba8047e593b32ec34ab7fba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:41.678375 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d5c34aba8047e593b32ec34ab7fba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:41.692074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d5c34aba8047e593b32ec34ab7fba9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:41.705322 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1433/2886] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:12:41 2022] DELETE /identity/v3/users/e6d5c34aba8047e593b32ec34ab7fba9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:41.905660 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:41.919061 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e52426-3446-4d84-828d-ee7c5e01ad17 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:41.990585 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:41.991474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:41.991764 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:41.992079 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] PATH_INFO: `/v3/projects/5eefb86101fe49f9953595f91d4a790a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:41.993892 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eefb86101fe49f9953595f91d4a790a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:41.995878 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.049162 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eefb86101fe49f9953595f91d4a790a', 'request_id': 'req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.056091 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eefb86101fe49f9953595f91d4a790a', 'request_id': 'req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.065457 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eefb86101fe49f9953595f91d4a790a', 'request_id': 'req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.078275 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] The token cache is being invalidate because project 5eefb86101fe49f9953595f91d4a790a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:42.078566 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.079229 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.080876 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1454/2887] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:12:41 2022] DELETE /identity/v3/projects/5eefb86101fe49f9953595f91d4a790a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:42.086055 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:42.087578 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:42.101096 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681bb5-1bc3-4eb5-a08e-586907feb0bc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.123558 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:42.168872 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.169758 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.170035 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.170313 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] PATH_INFO: `/v3/users/1a818a25d7b04a7f8f63dd536141ffa9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.171528 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a818a25d7b04a7f8f63dd536141ffa9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.173508 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.223987 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a818a25d7b04a7f8f63dd536141ffa9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.232754 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a818a25d7b04a7f8f63dd536141ffa9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.233409 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a818a25d7b04a7f8f63dd536141ffa9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.234074 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a818a25d7b04a7f8f63dd536141ffa9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.248312 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a818a25d7b04a7f8f63dd536141ffa9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.261749 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1434/2888] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:12:42 2022] DELETE /identity/v3/users/1a818a25d7b04a7f8f63dd536141ffa9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:12:42.444035 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:42.445599 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:42.459267 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4f582-fbf4-4999-b9ae-c4fb34d4fc91 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.463032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:42.519817 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.520727 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.521016 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.521298 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] PATH_INFO: `/v3/projects/cc0892227f1d404184ae8e4bf3c2c9ce` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.522493 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0892227f1d404184ae8e4bf3c2c9ce)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.524460 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.570950 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0892227f1d404184ae8e4bf3c2c9ce', 'request_id': 'req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.577193 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0892227f1d404184ae8e4bf3c2c9ce', 'request_id': 'req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.584996 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0892227f1d404184ae8e4bf3c2c9ce', 'request_id': 'req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.596155 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] The token cache is being invalidate because project cc0892227f1d404184ae8e4bf3c2c9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:42.596452 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.597121 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:42.598683 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1455/2889] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:12:42 2022] DELETE /identity/v3/projects/cc0892227f1d404184ae8e4bf3c2c9ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:12:52.257560 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:52.593032 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:20.052868 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.054464 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.184134 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d839da-f6dc-4256-ae35-a6149f75ceb8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.282723 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e36af3331a04e13b05fcbb8b2d9cd1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.283395 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.283681 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.283959 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.285866 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.302044 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.305022 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.326875 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1435/2890] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:23.626822 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.628927 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.705207 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa7a38-e4c3-4ae6-b581-c5965f0c3a99 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.709066 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eadb39271321475ebb10382db43db0b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.709726 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.710017 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.710294 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.712410 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.782983 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.784480 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.794604 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1456/2891] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:27.491073 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:27.493481 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:27.598782 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:27.626090 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e1fcc-7fba-4ad3-a301-7f9c580d4c0d service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:27.638289 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:27.639416 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:27.639894 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:27.640451 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:27.643598 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:27.669497 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:27.671157 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:27.684371 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1436/2892] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:13:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:31.178699 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.180221 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:31.193805 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7ce7e-1472-43d2-952c-445fe8938873 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.198640 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.200248 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.200550 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.200835 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] PATH_INFO: `/v3/users/9683ec43ae844757883a7dd5003b53d9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.202572 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9683ec43ae844757883a7dd5003b53d9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.204736 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.273473 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9683ec43ae844757883a7dd5003b53d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.289244 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9683ec43ae844757883a7dd5003b53d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.298122 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9683ec43ae844757883a7dd5003b53d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.307276 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9683ec43ae844757883a7dd5003b53d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.308618 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9683ec43ae844757883a7dd5003b53d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.316127 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1457/2893] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:13:31 2022] DELETE /identity/v3/users/9683ec43ae844757883a7dd5003b53d9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:31.506684 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.518777 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac03b3-ebf9-458b-ae03-7fa614f568dc service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.583021 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.583890 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.584222 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.584535 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] PATH_INFO: `/v3/projects/ba5a75cf80284f58b9c3bed674677a39` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.585745 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5a75cf80284f58b9c3bed674677a39)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.587706 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.643843 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5a75cf80284f58b9c3bed674677a39', 'request_id': 'req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.652694 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5a75cf80284f58b9c3bed674677a39', 'request_id': 'req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.659621 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5a75cf80284f58b9c3bed674677a39', 'request_id': 'req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.674617 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] The token cache is being invalidate because project ba5a75cf80284f58b9c3bed674677a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:31.674919 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.675591 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.677201 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1437/2894] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:13:31 2022] DELETE /identity/v3/projects/ba5a75cf80284f58b9c3bed674677a39 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:31.681482 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.683667 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:31.698474 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413eddf-f904-4bd1-83a2-27ec420c0986 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.713002 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:31.767654 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.768607 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.768897 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.769183 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] PATH_INFO: `/v3/users/a1dbbfc48cc642688950b14f5cddf28f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.771441 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1dbbfc48cc642688950b14f5cddf28f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.773501 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.826178 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1dbbfc48cc642688950b14f5cddf28f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.838828 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1dbbfc48cc642688950b14f5cddf28f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.846819 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1dbbfc48cc642688950b14f5cddf28f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.857761 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1dbbfc48cc642688950b14f5cddf28f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.858497 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1dbbfc48cc642688950b14f5cddf28f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.865020 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1458/2895] 10.222.0.69 () {58 vars in 1223 bytes} [Thu May 26 18:13:31 2022] DELETE /identity/v3/users/a1dbbfc48cc642688950b14f5cddf28f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:32.051170 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:32.054620 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:32.069297 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93a8ef-55c1-45eb-bf5b-11e9f72f5f59 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:32.147326 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a69d3812404e20840e7bb0da9d4d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ff1c526db504733a6f9bcf8c7e9e653', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:32.148234 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:32.148521 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:32.148801 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] PATH_INFO: `/v3/projects/7020bb1806764dd299f457750912d975` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:32.150037 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7020bb1806764dd299f457750912d975)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:32.152725 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:32.178700 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:32.217175 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7020bb1806764dd299f457750912d975', 'request_id': 'req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.225628 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7020bb1806764dd299f457750912d975', 'request_id': 'req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.233301 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7020bb1806764dd299f457750912d975', 'request_id': 'req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.245971 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] The token cache is being invalidate because project 7020bb1806764dd299f457750912d975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:32.246357 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.247013 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bf54f5d5-224c-42af-a97a-f2fa1fb859ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.248685 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1438/2896] 10.222.0.69 () {58 vars in 1232 bytes} [Thu May 26 18:13:32 2022] DELETE /identity/v3/projects/7020bb1806764dd299f457750912d975 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:41.861116 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:42.242701 dv-cinder-836074-5-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:22.816746 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:22.818169 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:22.936782 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04a9c-f6bc-40eb-8b74-971b929d44fb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:22.996700 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c98cc-ec8a-4d36-8795-d708ced03f9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2071d6186946488aac5df5fe4ab55c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4002e0cc7fbc4d27be081dc3e65f038f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:22.997392 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c98cc-ec8a-4d36-8795-d708ced03f9e service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:22.997688 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c98cc-ec8a-4d36-8795-d708ced03f9e service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:22.997967 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c98cc-ec8a-4d36-8795-d708ced03f9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:22.999751 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-db3c98cc-ec8a-4d36-8795-d708ced03f9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:23.011133 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c98cc-ec8a-4d36-8795-d708ced03f9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:23.012753 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c98cc-ec8a-4d36-8795-d708ced03f9e service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:23.023226 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1459/2897] 10.222.0.69 () {60 vars in 1365 bytes} [Thu May 26 18:14:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:33.018774 dv-cinder-836074-5-iscsi devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=77 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}